Jul 25 15:27:19 user nova-compute[70869]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 25 15:27:22 user nova-compute[70869]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70869) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 25 15:27:22 user nova-compute[70869]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70869) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 25 15:27:22 user nova-compute[70869]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70869) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 25 15:27:22 user nova-compute[70869]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 25 15:27:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:27:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:27:22 user nova-compute[70869]: INFO nova.virt.driver [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 25 15:27:23 user nova-compute[70869]: INFO nova.compute.provider_config [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] Acquiring lock "singleton_lock" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] Acquired lock "singleton_lock" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] Releasing lock "singleton_lock" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] Full set of CONF: {{(pid=70869) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ******************************************************************************** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] Configuration options gathered from: {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ================================================================================ {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] allow_resize_to_same_host      = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] arq_binding_timeout            = 300 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] backdoor_port                  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] backdoor_socket                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] block_device_allocate_retries  = 300 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] block_device_allocate_retries_interval = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cert                           = self.pem {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute_monitors               = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] config_dir                     = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] config_drive_format            = iso9660 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] config_source                  = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] console_host                   = user {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] control_exchange               = nova {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cpu_allocation_ratio           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] daemon                         = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] debug                          = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] default_access_ip_network_name = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] default_availability_zone      = nova {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] default_ephemeral_format       = ext4 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] default_schedule_zone          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] disk_allocation_ratio          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] enable_new_services            = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] enabled_apis                   = ['osapi_compute'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] enabled_ssl_apis               = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] flat_injected                  = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] force_config_drive             = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] force_raw_images               = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] graceful_shutdown_timeout      = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] heal_instance_info_cache_interval = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] host                           = user {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] instance_build_timeout         = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] instance_delete_interval       = 300 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] instance_format                = [instance: %(uuid)s]  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] instance_name_template         = instance-%08x {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] instance_usage_audit           = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] instance_usage_audit_period    = month {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] internal_service_availability_zone = internal {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] key                            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] live_migration_retry_count     = 30 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] log_config_append              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] log_dir                        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] log_file                       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] log_options                    = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] log_rotate_interval            = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] log_rotate_interval_type       = days {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] log_rotation_type              = none {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] long_rpc_timeout               = 1800 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] max_concurrent_builds          = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] max_concurrent_live_migrations = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] max_concurrent_snapshots       = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] max_local_block_devices        = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] max_logfile_count              = 30 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] max_logfile_size_mb            = 200 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] maximum_instance_delete_attempts = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] metadata_listen                = 0.0.0.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] metadata_listen_port           = 8775 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] metadata_workers               = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] migrate_max_retries            = -1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] mkisofs_cmd                    = genisoimage {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] my_ip                          = 10.0.0.210 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] network_allocate_retries       = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] osapi_compute_listen_port      = 8774 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] osapi_compute_unique_server_name_scope =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] osapi_compute_workers          = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] password_length                = 12 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] periodic_enable                = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] periodic_fuzzy_delay           = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] pointer_model                  = ps2mouse {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] preallocate_images             = none {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] publish_errors                 = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] pybasedir                      = /opt/stack/nova {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ram_allocation_ratio           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] rate_limit_burst               = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] rate_limit_except_level        = CRITICAL {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] rate_limit_interval            = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] reboot_timeout                 = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] reclaim_instance_interval      = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] record                         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] reimage_timeout_per_gb         = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] report_interval                = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] rescue_timeout                 = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] reserved_host_cpus             = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] reserved_host_disk_mb          = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] reserved_host_memory_mb        = 512 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] reserved_huge_pages            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] resize_confirm_window          = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] resize_fs_using_block_device   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] resume_guests_state_on_host_boot = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] rpc_response_timeout           = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] run_external_periodic_tasks    = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] running_deleted_instance_action = reap {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] running_deleted_instance_poll_interval = 1800 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] running_deleted_instance_timeout = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler_instance_sync_interval = 120 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_down_time              = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] servicegroup_driver            = db {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] shelved_offload_time           = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] shelved_poll_interval          = 3600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] shutdown_timeout               = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] source_is_ipv6                 = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ssl_only                       = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] state_path                     = /opt/stack/data/nova {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] sync_power_state_interval      = 600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] sync_power_state_pool_size     = 1000 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] syslog_log_facility            = LOG_USER {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] tempdir                        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] timeout_nbd                    = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] transport_url                  = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] update_resources_interval      = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] use_cow_images                 = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] use_eventlog                   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] use_journal                    = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] use_json                       = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] use_rootwrap_daemon            = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] use_stderr                     = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] use_syslog                     = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vcpu_pin_set                   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plugging_is_fatal          = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plugging_timeout           = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] virt_mkfs                      = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] volume_usage_poll_interval     = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] watch_log_file                 = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] web                            = /usr/share/spice-html5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_concurrency.disable_process_locking = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.auth_strategy              = keystone {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.compute_link_prefix        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.dhcp_domain                = novalocal {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.enable_instance_password   = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.glance_link_prefix         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.instance_list_per_project_cells = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.list_records_by_skipping_down_cells = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.local_metadata_per_cell    = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.max_limit                  = 1000 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.metadata_cache_expiration  = 15 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.neutron_default_tenant_id  = default {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.use_forwarded_for          = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.use_neutron_default_nets   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.vendordata_dynamic_targets = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.vendordata_jsonfile_path   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.backend                  = dogpile.cache.memcached {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.backend_argument         = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.config_prefix            = cache.oslo {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.dead_timeout             = 60.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.debug_cache_backend      = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.enable_retry_client      = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.enable_socket_keepalive  = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.enabled                  = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.expiration_time          = 600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.hashclient_retry_attempts = 2 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_dead_retry      = 300 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_password        =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_pool_maxsize    = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_sasl_enabled    = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.memcache_username        =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.proxies                  = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.retry_attempts           = 2 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.retry_delay              = 0.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.socket_keepalive_count   = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.socket_keepalive_idle    = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.socket_keepalive_interval = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.tls_allowed_ciphers      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.tls_cafile               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.tls_certfile             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.tls_enabled              = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cache.tls_keyfile              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.auth_section            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.auth_type               = password {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.cafile                  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.certfile                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.collect_timing          = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.cross_az_attach         = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.debug                   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.endpoint_template       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.http_retries            = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.insecure                = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.keyfile                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.os_region_name          = RegionOne {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.split_loggers           = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cinder.timeout                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.cpu_dedicated_set      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.cpu_shared_set         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.image_type_exclude_list = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.max_concurrent_disk_ops = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.max_disk_devices_to_attach = -1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.resource_provider_association_refresh = 300 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.shutdown_retry_interval = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] conductor.workers              = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] console.allowed_origins        = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] console.ssl_ciphers            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] console.ssl_minimum_version    = default {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] consoleauth.token_ttl          = 600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.cafile                  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.certfile                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.collect_timing          = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.connect_retries         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.connect_retry_delay     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.endpoint_override       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.insecure                = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.keyfile                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.max_version             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.min_version             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.region_name             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.service_name            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.service_type            = accelerator {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.split_loggers           = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.status_code_retries     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.status_code_retry_delay = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.timeout                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] cyborg.version                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.backend               = sqlalchemy {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.connection            = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.connection_debug      = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.connection_parameters =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.connection_recycle_time = 3600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.connection_trace      = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.db_inc_retry_interval = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.db_max_retries        = 20 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.db_max_retry_interval = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.db_retry_interval     = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.max_overflow          = 50 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.max_pool_size         = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.max_retries           = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.mysql_enable_ndb      = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.mysql_wsrep_sync_wait = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.pool_timeout          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.retry_interval        = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.slave_connection      = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] database.sqlite_synchronous    = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.backend           = sqlalchemy {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.connection        = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.connection_debug  = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.connection_parameters =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.connection_recycle_time = 3600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.connection_trace  = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.db_inc_retry_interval = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.db_max_retries    = 20 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.db_max_retry_interval = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.db_retry_interval = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.max_overflow      = 50 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.max_pool_size     = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.max_retries       = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.mysql_enable_ndb  = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.pool_timeout      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.retry_interval    = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.slave_connection  = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] api_database.sqlite_synchronous = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] devices.enabled_mdev_types     = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ephemeral_storage_encryption.enabled = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.api_servers             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.cafile                  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.certfile                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.collect_timing          = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.connect_retries         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.connect_retry_delay     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.debug                   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.default_trusted_certificate_ids = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.enable_certificate_validation = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.enable_rbd_download     = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.endpoint_override       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.insecure                = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.keyfile                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.max_version             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.min_version             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.num_retries             = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.rbd_ceph_conf           =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.rbd_connect_timeout     = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.rbd_pool                =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.rbd_user                =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.region_name             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.service_name            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.service_type            = image {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.split_loggers           = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.status_code_retries     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.status_code_retry_delay = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.timeout                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.verify_glance_signatures = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] glance.version                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] guestfs.debug                  = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.config_drive_cdrom      = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.config_drive_inject_password = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.enable_instance_metrics_collection = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.enable_remotefx         = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.instances_path_share    =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.iscsi_initiator_list    = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.limit_cpu_features      = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.power_state_check_timeframe = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.use_multipath_io        = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.volume_attach_retry_count = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.vswitch_name            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] mks.enabled                    = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] image_cache.manager_interval   = 2400 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] image_cache.precache_concurrency = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] image_cache.remove_unused_base_images = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] image_cache.subdirectory_name  = _base {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.api_max_retries         = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.api_retry_interval      = 2 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.auth_section            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.auth_type               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.cafile                  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.certfile                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.collect_timing          = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.connect_retries         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.connect_retry_delay     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.endpoint_override       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.insecure                = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.keyfile                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.max_version             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.min_version             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.partition_key           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.peer_list               = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.region_name             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.serial_console_state_timeout = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.service_name            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.service_type            = baremetal {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.split_loggers           = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.status_code_retries     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.status_code_retry_delay = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.timeout                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ironic.version                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] key_manager.fixed_key          = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.barbican_api_version  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.barbican_endpoint     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.barbican_endpoint_type = public {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.barbican_region_name  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.cafile                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.certfile              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.collect_timing        = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.insecure              = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.keyfile               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.number_of_retries     = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.retry_delay           = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.send_service_user_token = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.split_loggers         = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.timeout               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.verify_ssl            = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican.verify_ssl_path       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican_service_user.auth_section = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican_service_user.auth_type = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican_service_user.cafile   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican_service_user.certfile = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican_service_user.collect_timing = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican_service_user.insecure = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican_service_user.keyfile  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican_service_user.split_loggers = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] barbican_service_user.timeout  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.approle_role_id          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.approle_secret_id        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.cafile                   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.certfile                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.collect_timing           = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.insecure                 = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.keyfile                  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.kv_mountpoint            = secret {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.kv_version               = 2 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.namespace                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.root_token_id            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.split_loggers            = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.ssl_ca_crt_file          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.timeout                  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.use_ssl                  = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.cafile                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.certfile              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.collect_timing        = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.connect_retries       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.connect_retry_delay   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.endpoint_override     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.insecure              = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.keyfile               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.max_version           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.min_version           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.region_name           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.service_name          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.service_type          = identity {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.split_loggers         = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.status_code_retries   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.status_code_retry_delay = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.timeout               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] keystone.version               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.connection_uri         =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.cpu_mode               = custom {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: WARNING oslo_config.cfg [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.cpu_power_governor_high = performance {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.cpu_power_governor_low = powersave {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.cpu_power_management   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.device_detach_attempts = 8 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.device_detach_timeout  = 20 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.disk_cachemodes        = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.disk_prefix            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.enabled_perf_events    = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.file_backed_memory     = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.gid_maps               = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.hw_disk_discard        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.hw_machine_type        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.images_rbd_glance_store_name =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.images_rbd_pool        = rbd {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.images_type            = default {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.images_volume_group    = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.inject_key             = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.inject_partition       = -2 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.inject_password        = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.iscsi_iface            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.iser_use_multipath     = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_bandwidth = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_downtime = 500 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_inbound_addr = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_permit_post_copy = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_scheme  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_timeout_action = abort {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_tunnelled = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: WARNING oslo_config.cfg [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 25 15:27:23 user nova-compute[70869]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 25 15:27:23 user nova-compute[70869]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 25 15:27:23 user nova-compute[70869]: and ``live_migration_inbound_addr`` respectively.
Jul 25 15:27:23 user nova-compute[70869]: ).  Its value may be silently ignored in the future.
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.live_migration_with_native_tls = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.max_queues             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.nfs_mount_options      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.num_memory_encrypted_guests = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.num_pcie_ports         = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.pmem_namespaces        = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.quobyte_client_cfg     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rbd_secret_uuid        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rbd_user               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.remote_filesystem_transport = ssh {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rescue_image_id        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rescue_kernel_id       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rescue_ramdisk_id      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.rx_queue_size          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.smbfs_mount_options    =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.snapshot_compression   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.snapshot_image_format  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.sparse_logical_volumes = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.swtpm_enabled          = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.swtpm_group            = tss {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.swtpm_user             = tss {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.sysinfo_serial         = unique {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.tb_cache_size          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.tx_queue_size          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.uid_maps               = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.use_virtio_for_bridges = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.virt_type              = kvm {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.volume_clear           = zero {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.volume_clear_size      = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.volume_use_multipath   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.vzstorage_cache_path   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.vzstorage_mount_user   = stack {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.auth_section           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.auth_type              = password {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.cafile                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.certfile               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.collect_timing         = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.connect_retries        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.connect_retry_delay    = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.default_floating_pool  = public {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.endpoint_override      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.extension_sync_interval = 600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.http_retries           = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.insecure               = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.keyfile                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.max_version            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.min_version            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.ovs_bridge             = br-int {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.physnets               = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.region_name            = RegionOne {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.service_metadata_proxy = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.service_name           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.service_type           = network {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.split_loggers          = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.status_code_retries    = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.status_code_retry_delay = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.timeout                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] neutron.version                = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] notifications.bdms_in_notifications = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] notifications.default_level    = INFO {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] notifications.notification_format = unversioned {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] notifications.notify_on_state_change = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] pci.alias                      = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] pci.device_spec                = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] pci.report_in_placement        = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.auth_section         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.auth_type            = password {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.cafile               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.certfile             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.collect_timing       = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.connect_retries      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.connect_retry_delay  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.default_domain_id    = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.default_domain_name  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.domain_id            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.domain_name          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.endpoint_override    = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.insecure             = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.keyfile              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.max_version          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.min_version          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.password             = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.project_domain_id    = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.project_domain_name  = Default {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.project_id           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.project_name         = service {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.region_name          = RegionOne {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.service_name         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.service_type         = placement {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.split_loggers        = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.status_code_retries  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.status_code_retry_delay = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.system_scope         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.timeout              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.trust_id             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.user_domain_id       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.user_domain_name     = Default {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.user_id              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.username             = placement {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] placement.version              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.cores                    = 20 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.count_usage_from_placement = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.injected_file_content_bytes = 10240 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.injected_file_path_length = 255 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.injected_files           = 5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.instances                = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.key_pairs                = 100 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.metadata_items           = 128 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.ram                      = 51200 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.recheck_quota            = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.server_group_members     = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] quota.server_groups            = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] rdp.enabled                    = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.image_metadata_prefilter = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.max_attempts         = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.max_placement_results = 1000 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.query_placement_for_availability_zone = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.query_placement_for_image_type_support = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] scheduler.workers              = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.host_subset_size = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.isolated_hosts = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.isolated_images = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.pci_in_placement = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.track_instance_changes = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] metrics.required               = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] metrics.weight_multiplier      = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] metrics.weight_setting         = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] serial_console.enabled         = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] serial_console.port_range      = 10000:20000 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] serial_console.serialproxy_port = 6083 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.auth_section      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.auth_type         = password {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.cafile            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.certfile          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.collect_timing    = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.insecure          = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.keyfile           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.send_service_user_token = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.split_loggers     = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] service_user.timeout           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.agent_enabled            = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.enabled                  = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.html5proxy_port          = 6082 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.image_compression        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.jpeg_compression         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.playback_compression     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.server_listen            = 127.0.0.1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.streaming_mode           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] spice.zlib_compression         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] upgrade_levels.baseapi         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] upgrade_levels.cert            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] upgrade_levels.compute         = auto {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] upgrade_levels.conductor       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] upgrade_levels.scheduler       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vendordata_dynamic_auth.auth_section = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vendordata_dynamic_auth.auth_type = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vendordata_dynamic_auth.cafile = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vendordata_dynamic_auth.certfile = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vendordata_dynamic_auth.insecure = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vendordata_dynamic_auth.keyfile = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vendordata_dynamic_auth.timeout = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.api_retry_count         = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.ca_file                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.cache_prefix            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.cluster_name            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.connection_pool_size    = 10 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.console_delay_seconds   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.datastore_regex         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.host_ip                 = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.host_password           = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.host_port               = 443 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.host_username           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.insecure                = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.integration_bridge      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.maximum_objects         = 100 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.pbm_default_policy      = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.pbm_enabled             = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.pbm_wsdl_location       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.serial_port_proxy_uri   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.serial_port_service_uri = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.task_poll_interval      = 0.5 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.use_linked_clone        = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.vnc_keymap              = en-us {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.vnc_port                = 5900 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vmware.vnc_port_total          = 10000 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.auth_schemes               = ['none'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.enabled                    = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.novncproxy_port            = 6080 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.server_listen              = 0.0.0.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.vencrypt_ca_certs          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.vencrypt_client_cert       = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vnc.vencrypt_client_key        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.disable_rootwrap   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.enable_numa_live_migration = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.libvirt_disable_apic = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.client_socket_timeout     = 900 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.default_pool_size         = 1000 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.keep_alive                = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.max_header_line           = 16384 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.ssl_ca_file               = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.ssl_cert_file             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.ssl_key_file              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.tcp_keepidle              = 600 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] zvm.ca_file                    = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] zvm.cloud_connector_url        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] zvm.reachable_timeout          = 300 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.enforce_new_defaults = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.enforce_scope      = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.policy_default_rule = default {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.policy_file        = policy.yaml {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.connection_string     = messaging:// {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.enabled               = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.es_doc_type           = notification {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.es_scroll_size        = 10000 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.es_scroll_time        = 2m {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.filter_error_trace    = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.hmac_keys             = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.sentinel_service_name = mymaster {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.socket_timeout        = 0.1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.trace_requests        = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler.trace_sqlalchemy      = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler_jaeger.process_tags   = {} {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler_jaeger.service_name_prefix = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] profiler_otlp.service_name_prefix = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] remote_debug.host              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] remote_debug.port              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.ssl      = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_notifications.retry = -1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_messaging_notifications.transport_url = **** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.auth_section        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.auth_type           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.cafile              = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.certfile            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.collect_timing      = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.connect_retries     = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.connect_retry_delay = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.endpoint_id         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.endpoint_override   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.insecure            = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.keyfile             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.max_version         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.min_version         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.region_name         = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.service_name        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.service_type        = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.split_loggers       = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.status_code_retries = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.status_code_retry_delay = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.timeout             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.valid_interfaces    = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_limit.version             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_reports.file_event_handler = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] oslo_reports.log_dir           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_ovs_privileged.group  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] vif_plug_ovs_privileged.user   = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_linux_bridge.flat_interface = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_ovs.isolate_vif         = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_vif_ovs.per_port_bridge     = False {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] os_brick.lock_path             = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] privsep_osbrick.capabilities   = [21] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] privsep_osbrick.group          = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] privsep_osbrick.helper_command = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] privsep_osbrick.user           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] nova_sys_admin.group           = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] nova_sys_admin.helper_command  = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] nova_sys_admin.user            = None {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG oslo_service.service [None req-71cd97c3-97a5-4123-8fc8-5c04b0b7f19a None None] ******************************************************************************** {{(pid=70869) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 25 15:27:23 user nova-compute[70869]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 25 15:27:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Starting native event thread {{(pid=70869) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Starting green dispatch thread {{(pid=70869) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Starting connection event dispatch thread {{(pid=70869) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Connecting to libvirt: qemu:///system {{(pid=70869) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe43f0bf520> {{(pid=70869) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 25 15:27:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe43f0bf520> {{(pid=70869) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 25 15:27:23 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Connection event '1' reason 'None'
Jul 25 15:27:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 25 15:27:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.mount [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Initialising _HostMountState generation 0 {{(pid=70869) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 25 15:27:31 user nova-compute[70869]: INFO nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt host capabilities <capabilities>
Jul 25 15:27:31 user nova-compute[70869]:   <host>
Jul 25 15:27:31 user nova-compute[70869]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 25 15:27:31 user nova-compute[70869]:     <cpu>
Jul 25 15:27:31 user nova-compute[70869]:       <arch>x86_64</arch>
Jul 25 15:27:31 user nova-compute[70869]:       <model>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <vendor>Intel</vendor>
Jul 25 15:27:31 user nova-compute[70869]:       <microcode version='1070'/>
Jul 25 15:27:31 user nova-compute[70869]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 25 15:27:31 user nova-compute[70869]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='ss'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='vmx'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='pcid'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='osxsave'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='hypervisor'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='arat'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='tsc_adjust'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='md-clear'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='arch-capabilities'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='invtsc'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='rsba'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature name='skip-l1dfl-vmentry'/>
Jul 25 15:27:31 user nova-compute[70869]:       <pages unit='KiB' size='4'/>
Jul 25 15:27:31 user nova-compute[70869]:       <pages unit='KiB' size='2048'/>
Jul 25 15:27:31 user nova-compute[70869]:     </cpu>
Jul 25 15:27:31 user nova-compute[70869]:     <power_management>
Jul 25 15:27:31 user nova-compute[70869]:       <suspend_mem/>
Jul 25 15:27:31 user nova-compute[70869]:       <suspend_disk/>
Jul 25 15:27:31 user nova-compute[70869]:       <suspend_hybrid/>
Jul 25 15:27:31 user nova-compute[70869]:     </power_management>
Jul 25 15:27:31 user nova-compute[70869]:     <iommu support='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     <migration_features>
Jul 25 15:27:31 user nova-compute[70869]:       <live/>
Jul 25 15:27:31 user nova-compute[70869]:       <uri_transports>
Jul 25 15:27:31 user nova-compute[70869]:         <uri_transport>tcp</uri_transport>
Jul 25 15:27:31 user nova-compute[70869]:         <uri_transport>rdma</uri_transport>
Jul 25 15:27:31 user nova-compute[70869]:       </uri_transports>
Jul 25 15:27:31 user nova-compute[70869]:     </migration_features>
Jul 25 15:27:31 user nova-compute[70869]:     <topology>
Jul 25 15:27:31 user nova-compute[70869]:       <cells num='2'>
Jul 25 15:27:31 user nova-compute[70869]:         <cell id='0'>
Jul 25 15:27:31 user nova-compute[70869]:           <memory unit='KiB'>8189224</memory>
Jul 25 15:27:31 user nova-compute[70869]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 25 15:27:31 user nova-compute[70869]:           <pages unit='KiB' size='2048'>0</pages>
Jul 25 15:27:31 user nova-compute[70869]:           <distances>
Jul 25 15:27:31 user nova-compute[70869]:             <sibling id='0' value='10'/>
Jul 25 15:27:31 user nova-compute[70869]:             <sibling id='1' value='20'/>
Jul 25 15:27:31 user nova-compute[70869]:           </distances>
Jul 25 15:27:31 user nova-compute[70869]:           <cpus num='6'>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 25 15:27:31 user nova-compute[70869]:           </cpus>
Jul 25 15:27:31 user nova-compute[70869]:         </cell>
Jul 25 15:27:31 user nova-compute[70869]:         <cell id='1'>
Jul 25 15:27:31 user nova-compute[70869]:           <memory unit='KiB'>8206460</memory>
Jul 25 15:27:31 user nova-compute[70869]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 25 15:27:31 user nova-compute[70869]:           <pages unit='KiB' size='2048'>0</pages>
Jul 25 15:27:31 user nova-compute[70869]:           <distances>
Jul 25 15:27:31 user nova-compute[70869]:             <sibling id='0' value='20'/>
Jul 25 15:27:31 user nova-compute[70869]:             <sibling id='1' value='10'/>
Jul 25 15:27:31 user nova-compute[70869]:           </distances>
Jul 25 15:27:31 user nova-compute[70869]:           <cpus num='6'>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 25 15:27:31 user nova-compute[70869]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 25 15:27:31 user nova-compute[70869]:           </cpus>
Jul 25 15:27:31 user nova-compute[70869]:         </cell>
Jul 25 15:27:31 user nova-compute[70869]:       </cells>
Jul 25 15:27:31 user nova-compute[70869]:     </topology>
Jul 25 15:27:31 user nova-compute[70869]:     <cache>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 25 15:27:31 user nova-compute[70869]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 25 15:27:31 user nova-compute[70869]:     </cache>
Jul 25 15:27:31 user nova-compute[70869]:     <secmodel>
Jul 25 15:27:31 user nova-compute[70869]:       <model>apparmor</model>
Jul 25 15:27:31 user nova-compute[70869]:       <doi>0</doi>
Jul 25 15:27:31 user nova-compute[70869]:     </secmodel>
Jul 25 15:27:31 user nova-compute[70869]:     <secmodel>
Jul 25 15:27:31 user nova-compute[70869]:       <model>dac</model>
Jul 25 15:27:31 user nova-compute[70869]:       <doi>0</doi>
Jul 25 15:27:31 user nova-compute[70869]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 25 15:27:31 user nova-compute[70869]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 25 15:27:31 user nova-compute[70869]:     </secmodel>
Jul 25 15:27:31 user nova-compute[70869]:   </host>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='alpha'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>clipper</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='armv6l'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>integratorcp</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>borzoi</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>spitz</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>nuri</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>musca-b1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>versatileab</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>kzm</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>musca-a</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>smdkc210</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sx1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>z2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>tosa</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>sabrelite</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>realview-eb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>n810</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>n800</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>versatilepb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>terrier</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mainstone</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>midway</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>musicpal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>microbit</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>cubieboard</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>verdex</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>netduino2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>raspi2b</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>cheetah</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>highbank</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>akita</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>connex</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>collie</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>raspi0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='armv7l'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>integratorcp</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>borzoi</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>spitz</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>nuri</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>musca-b1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>versatileab</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>kzm</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>musca-a</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>smdkc210</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sx1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>z2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>tosa</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>sabrelite</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>realview-eb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>n810</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>n800</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>versatilepb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>terrier</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mainstone</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>midway</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>musicpal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>microbit</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>cubieboard</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>verdex</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>netduino2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>raspi2b</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>cheetah</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>highbank</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>akita</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>connex</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>collie</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>raspi0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='aarch64'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>integratorcp</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>borzoi</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>spitz</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>nuri</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>musca-b1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>versatileab</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>kzm</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>musca-a</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>smdkc210</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sx1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>z2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>tosa</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>sabrelite</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>realview-eb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>n810</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>n800</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>versatilepb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>terrier</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mainstone</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>midway</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>musicpal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>microbit</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>cubieboard</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>verdex</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>netduino2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>raspi3b</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>raspi2b</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>cheetah</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>highbank</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>akita</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>connex</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>collie</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>raspi0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <acpi default='on' toggle='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='cris'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='i686'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>x-remote</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>isapc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>microvm</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='kvm'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <pae/>
Jul 25 15:27:31 user nova-compute[70869]:       <nonpae/>
Jul 25 15:27:31 user nova-compute[70869]:       <acpi default='on' toggle='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:       <apic default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='m68k'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>an5206</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>q800</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>next-cube</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='microblaze'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='microblazeel'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='mips'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='16'>malta</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='mipsel'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='16'>malta</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='mips64'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='16'>malta</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>pica61</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>magnum</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='mips64el'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='16'>malta</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mipssim</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>pica61</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>magnum</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='16'>boston</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='ppc'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>g3beige</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mac99</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>ppce500</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>pegasos2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sam460ex</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>bamboo</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>40p</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>ref405ep</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>taihu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='ppc64'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2048'>powernv9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>taihu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2048'>powernv10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>ppce500</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>40p</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>pegasos2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>bamboo</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>g3beige</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mac99</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sam460ex</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>ref405ep</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2048'>powernv8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='ppc64le'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2048'>powernv9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>taihu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2048'>powernv10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>ppce500</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>40p</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>pegasos2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>bamboo</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>g3beige</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>mac99</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sam460ex</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>ref405ep</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2048'>powernv8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='riscv32'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='8'>spike</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>opentitan</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='5'>sifive_u</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sifive_e</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='8'>virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='riscv64'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='8'>spike</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='5'>sifive_u</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>shakti_c</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sifive_e</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='8'>virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='s390x'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='sh4'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>shix</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>r2d</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='sh4eb'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>shix</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>r2d</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='sparc'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>SS-5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>SS-20</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>LX</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>SS-4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>SS-10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>Voyager</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='sparc64'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sun4u</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>niagara</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>sun4v</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='x86_64'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>64</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>x-remote</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='1'>isapc</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>microvm</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='kvm'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <acpi default='on' toggle='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:       <apic default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='xtensa'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>sim</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>kc705</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>ml605</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>lx200</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>lx60</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]:   <guest>
Jul 25 15:27:31 user nova-compute[70869]:     <os_type>hvm</os_type>
Jul 25 15:27:31 user nova-compute[70869]:     <arch name='xtensaeb'>
Jul 25 15:27:31 user nova-compute[70869]:       <wordsize>32</wordsize>
Jul 25 15:27:31 user nova-compute[70869]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='4'>sim</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>kc705</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>ml605</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>virt</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>lx200</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>lx60</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 25 15:27:31 user nova-compute[70869]:       <domain type='qemu'/>
Jul 25 15:27:31 user nova-compute[70869]:     </arch>
Jul 25 15:27:31 user nova-compute[70869]:     <features>
Jul 25 15:27:31 user nova-compute[70869]:       <cpuselection/>
Jul 25 15:27:31 user nova-compute[70869]:       <deviceboot/>
Jul 25 15:27:31 user nova-compute[70869]:       <disksnapshot default='on' toggle='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     </features>
Jul 25 15:27:31 user nova-compute[70869]:   </guest>
Jul 25 15:27:31 user nova-compute[70869]: </capabilities>
Jul 25 15:27:31 user nova-compute[70869]: 
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 25 15:27:31 user nova-compute[70869]: <domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 15:27:31 user nova-compute[70869]:   <domain>kvm</domain>
Jul 25 15:27:31 user nova-compute[70869]:   <machine>pc-q35-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:   <arch>i686</arch>
Jul 25 15:27:31 user nova-compute[70869]:   <vcpu max='288'/>
Jul 25 15:27:31 user nova-compute[70869]:   <iothreads supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:   <os supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='firmware'/>
Jul 25 15:27:31 user nova-compute[70869]:     <loader supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>rom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pflash</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='readonly'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='secure'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </loader>
Jul 25 15:27:31 user nova-compute[70869]:   </os>
Jul 25 15:27:31 user nova-compute[70869]:   <cpu>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-passthrough' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='hostPassthroughMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='maximum' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='maximumMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-model' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <vendor>Intel</vendor>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ss'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='vmx'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pcid'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='hypervisor'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arat'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='umip'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='md-clear'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibpb'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibrs'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='erms'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='lm'/>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='custom' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>qemu64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>qemu32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>phenom</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>n270</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>kvm64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>coreduo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>core2duo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>athlon</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Westmere</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Snowridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Penryn</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G5</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G4</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G1</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Nehalem</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Rome</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Milan</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Dhyana</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cooperlake</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Conroe</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>486</model>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:   </cpu>
Jul 25 15:27:31 user nova-compute[70869]:   <memoryBacking supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='sourceType'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>file</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>anonymous</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>memfd</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:   </memoryBacking>
Jul 25 15:27:31 user nova-compute[70869]:   <devices>
Jul 25 15:27:31 user nova-compute[70869]:     <disk supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='diskDevice'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>disk</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cdrom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>floppy</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>lun</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='bus'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>fdc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sata</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </disk>
Jul 25 15:27:31 user nova-compute[70869]:     <graphics supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sdl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vnc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>spice</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egl-headless</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </graphics>
Jul 25 15:27:31 user nova-compute[70869]:     <video supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='modelType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cirrus</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vmvga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>qxl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>none</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>bochs</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ramfb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </video>
Jul 25 15:27:31 user nova-compute[70869]:     <hostdev supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='mode'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>subsystem</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='startupPolicy'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>default</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>mandatory</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>requisite</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>optional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='subsysType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pci</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='capsType'/>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='pciBackend'/>
Jul 25 15:27:31 user nova-compute[70869]:     </hostdev>
Jul 25 15:27:31 user nova-compute[70869]:     <rng supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>random</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egd</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>builtin</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </rng>
Jul 25 15:27:31 user nova-compute[70869]:     <filesystem supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='driverType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>path</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>handle</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtiofs</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </filesystem>
Jul 25 15:27:31 user nova-compute[70869]:     <tpm supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-tis</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-crb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>passthrough</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>emulator</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </tpm>
Jul 25 15:27:31 user nova-compute[70869]:   </devices>
Jul 25 15:27:31 user nova-compute[70869]:   <features>
Jul 25 15:27:31 user nova-compute[70869]:     <gic supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     <vmcoreinfo supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <genid supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backingStoreInput supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backup supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <sev supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:   </features>
Jul 25 15:27:31 user nova-compute[70869]: </domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:  {{(pid=70869) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 25 15:27:31 user nova-compute[70869]: <domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 15:27:31 user nova-compute[70869]:   <domain>kvm</domain>
Jul 25 15:27:31 user nova-compute[70869]:   <machine>pc-i440fx-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:   <arch>i686</arch>
Jul 25 15:27:31 user nova-compute[70869]:   <vcpu max='255'/>
Jul 25 15:27:31 user nova-compute[70869]:   <iothreads supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:   <os supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='firmware'/>
Jul 25 15:27:31 user nova-compute[70869]:     <loader supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>rom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pflash</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='readonly'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='secure'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </loader>
Jul 25 15:27:31 user nova-compute[70869]:   </os>
Jul 25 15:27:31 user nova-compute[70869]:   <cpu>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-passthrough' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='hostPassthroughMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='maximum' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='maximumMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-model' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <vendor>Intel</vendor>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ss'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='vmx'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pcid'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='hypervisor'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arat'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='umip'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='md-clear'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibpb'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibrs'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='erms'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='lm'/>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='custom' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>qemu64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>qemu32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>phenom</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>n270</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>kvm64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>coreduo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>core2duo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>athlon</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Westmere</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Snowridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Penryn</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G5</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G4</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G1</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Nehalem</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Rome</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Milan</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Dhyana</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cooperlake</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Conroe</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>486</model>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:   </cpu>
Jul 25 15:27:31 user nova-compute[70869]:   <memoryBacking supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='sourceType'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>file</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>anonymous</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>memfd</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:   </memoryBacking>
Jul 25 15:27:31 user nova-compute[70869]:   <devices>
Jul 25 15:27:31 user nova-compute[70869]:     <disk supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='diskDevice'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>disk</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cdrom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>floppy</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>lun</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='bus'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ide</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>fdc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sata</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </disk>
Jul 25 15:27:31 user nova-compute[70869]:     <graphics supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sdl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vnc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>spice</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egl-headless</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </graphics>
Jul 25 15:27:31 user nova-compute[70869]:     <video supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='modelType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cirrus</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vmvga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>qxl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>none</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>bochs</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ramfb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </video>
Jul 25 15:27:31 user nova-compute[70869]:     <hostdev supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='mode'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>subsystem</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='startupPolicy'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>default</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>mandatory</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>requisite</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>optional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='subsysType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pci</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='capsType'/>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='pciBackend'/>
Jul 25 15:27:31 user nova-compute[70869]:     </hostdev>
Jul 25 15:27:31 user nova-compute[70869]:     <rng supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>random</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egd</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>builtin</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </rng>
Jul 25 15:27:31 user nova-compute[70869]:     <filesystem supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='driverType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>path</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>handle</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtiofs</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </filesystem>
Jul 25 15:27:31 user nova-compute[70869]:     <tpm supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-tis</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-crb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>passthrough</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>emulator</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </tpm>
Jul 25 15:27:31 user nova-compute[70869]:   </devices>
Jul 25 15:27:31 user nova-compute[70869]:   <features>
Jul 25 15:27:31 user nova-compute[70869]:     <gic supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     <vmcoreinfo supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <genid supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backingStoreInput supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backup supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <sev supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:   </features>
Jul 25 15:27:31 user nova-compute[70869]: </domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:  {{(pid=70869) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 25 15:27:31 user nova-compute[70869]: <domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 15:27:31 user nova-compute[70869]:   <domain>kvm</domain>
Jul 25 15:27:31 user nova-compute[70869]:   <machine>pc-i440fx-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:   <arch>i686</arch>
Jul 25 15:27:31 user nova-compute[70869]:   <vcpu max='255'/>
Jul 25 15:27:31 user nova-compute[70869]:   <iothreads supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:   <os supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='firmware'/>
Jul 25 15:27:31 user nova-compute[70869]:     <loader supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>rom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pflash</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='readonly'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='secure'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </loader>
Jul 25 15:27:31 user nova-compute[70869]:   </os>
Jul 25 15:27:31 user nova-compute[70869]:   <cpu>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-passthrough' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='hostPassthroughMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='maximum' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='maximumMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-model' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <vendor>Intel</vendor>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ss'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='vmx'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pcid'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='hypervisor'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arat'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='umip'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='md-clear'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibpb'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibrs'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='erms'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='lm'/>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='custom' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>qemu64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>qemu32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>phenom</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>n270</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>kvm64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>coreduo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>core2duo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>athlon</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Westmere</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Snowridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Penryn</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G5</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G4</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G1</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Nehalem</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Rome</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Milan</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Dhyana</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cooperlake</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Conroe</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>486</model>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:   </cpu>
Jul 25 15:27:31 user nova-compute[70869]:   <memoryBacking supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='sourceType'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>file</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>anonymous</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>memfd</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:   </memoryBacking>
Jul 25 15:27:31 user nova-compute[70869]:   <devices>
Jul 25 15:27:31 user nova-compute[70869]:     <disk supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='diskDevice'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>disk</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cdrom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>floppy</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>lun</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='bus'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ide</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>fdc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sata</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </disk>
Jul 25 15:27:31 user nova-compute[70869]:     <graphics supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sdl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vnc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>spice</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egl-headless</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </graphics>
Jul 25 15:27:31 user nova-compute[70869]:     <video supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='modelType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cirrus</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vmvga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>qxl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>none</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>bochs</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ramfb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </video>
Jul 25 15:27:31 user nova-compute[70869]:     <hostdev supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='mode'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>subsystem</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='startupPolicy'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>default</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>mandatory</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>requisite</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>optional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='subsysType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pci</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='capsType'/>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='pciBackend'/>
Jul 25 15:27:31 user nova-compute[70869]:     </hostdev>
Jul 25 15:27:31 user nova-compute[70869]:     <rng supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>random</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egd</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>builtin</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </rng>
Jul 25 15:27:31 user nova-compute[70869]:     <filesystem supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='driverType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>path</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>handle</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtiofs</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </filesystem>
Jul 25 15:27:31 user nova-compute[70869]:     <tpm supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-tis</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-crb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>passthrough</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>emulator</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </tpm>
Jul 25 15:27:31 user nova-compute[70869]:   </devices>
Jul 25 15:27:31 user nova-compute[70869]:   <features>
Jul 25 15:27:31 user nova-compute[70869]:     <gic supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     <vmcoreinfo supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <genid supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backingStoreInput supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backup supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <sev supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:   </features>
Jul 25 15:27:31 user nova-compute[70869]: </domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:  {{(pid=70869) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 25 15:27:31 user nova-compute[70869]: <domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:   <path>/usr/bin/qemu-system-i386</path>
Jul 25 15:27:31 user nova-compute[70869]:   <domain>kvm</domain>
Jul 25 15:27:31 user nova-compute[70869]:   <machine>pc-q35-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:   <arch>i686</arch>
Jul 25 15:27:31 user nova-compute[70869]:   <vcpu max='288'/>
Jul 25 15:27:31 user nova-compute[70869]:   <iothreads supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:   <os supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='firmware'/>
Jul 25 15:27:31 user nova-compute[70869]:     <loader supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>rom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pflash</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='readonly'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='secure'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </loader>
Jul 25 15:27:31 user nova-compute[70869]:   </os>
Jul 25 15:27:31 user nova-compute[70869]:   <cpu>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-passthrough' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='hostPassthroughMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='maximum' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='maximumMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-model' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <vendor>Intel</vendor>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ss'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='vmx'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pcid'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='hypervisor'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arat'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='umip'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='md-clear'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibpb'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibrs'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='erms'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='lm'/>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='custom' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>qemu64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>qemu32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>phenom</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>n270</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>kvm64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>coreduo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>core2duo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>athlon</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Westmere-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Westmere</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Snowridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Penryn</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G5</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G4</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G1</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Nehalem-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Nehalem</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Rome</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Milan</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Dhyana</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cooperlake</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Conroe</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>486</model>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:   </cpu>
Jul 25 15:27:31 user nova-compute[70869]:   <memoryBacking supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='sourceType'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>file</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>anonymous</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>memfd</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:   </memoryBacking>
Jul 25 15:27:31 user nova-compute[70869]:   <devices>
Jul 25 15:27:31 user nova-compute[70869]:     <disk supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='diskDevice'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>disk</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cdrom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>floppy</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>lun</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='bus'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>fdc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sata</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </disk>
Jul 25 15:27:31 user nova-compute[70869]:     <graphics supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sdl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vnc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>spice</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egl-headless</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </graphics>
Jul 25 15:27:31 user nova-compute[70869]:     <video supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='modelType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cirrus</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vmvga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>qxl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>none</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>bochs</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ramfb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </video>
Jul 25 15:27:31 user nova-compute[70869]:     <hostdev supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='mode'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>subsystem</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='startupPolicy'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>default</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>mandatory</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>requisite</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>optional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='subsysType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pci</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='capsType'/>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='pciBackend'/>
Jul 25 15:27:31 user nova-compute[70869]:     </hostdev>
Jul 25 15:27:31 user nova-compute[70869]:     <rng supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>random</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egd</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>builtin</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </rng>
Jul 25 15:27:31 user nova-compute[70869]:     <filesystem supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='driverType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>path</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>handle</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtiofs</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </filesystem>
Jul 25 15:27:31 user nova-compute[70869]:     <tpm supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-tis</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-crb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>passthrough</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>emulator</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </tpm>
Jul 25 15:27:31 user nova-compute[70869]:   </devices>
Jul 25 15:27:31 user nova-compute[70869]:   <features>
Jul 25 15:27:31 user nova-compute[70869]:     <gic supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     <vmcoreinfo supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <genid supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backingStoreInput supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backup supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <sev supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:   </features>
Jul 25 15:27:31 user nova-compute[70869]: </domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:  {{(pid=70869) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 25 15:27:31 user nova-compute[70869]: <domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 15:27:31 user nova-compute[70869]:   <domain>kvm</domain>
Jul 25 15:27:31 user nova-compute[70869]:   <machine>pc-q35-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:   <arch>x86_64</arch>
Jul 25 15:27:31 user nova-compute[70869]:   <vcpu max='288'/>
Jul 25 15:27:31 user nova-compute[70869]:   <iothreads supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:   <os supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='firmware'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>efi</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:     <loader supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>rom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pflash</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='readonly'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='secure'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </loader>
Jul 25 15:27:31 user nova-compute[70869]:   </os>
Jul 25 15:27:31 user nova-compute[70869]:   <cpu>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-passthrough' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='hostPassthroughMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='maximum' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='maximumMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-model' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <vendor>Intel</vendor>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ss'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='vmx'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pcid'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='hypervisor'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arat'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='umip'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='md-clear'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='invtsc'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibpb'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibrs'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='rsba'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='erms'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='custom' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>qemu64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>qemu32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>phenom</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>n270</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>coreduo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>core2duo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>athlon</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Westmere</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Snowridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Penryn</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G5</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G4</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Opteron_G1</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Nehalem</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Rome</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Milan</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Dhyana</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cooperlake</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Conroe</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>486</model>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:   </cpu>
Jul 25 15:27:31 user nova-compute[70869]:   <memoryBacking supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='sourceType'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>file</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>anonymous</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>memfd</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:   </memoryBacking>
Jul 25 15:27:31 user nova-compute[70869]:   <devices>
Jul 25 15:27:31 user nova-compute[70869]:     <disk supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='diskDevice'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>disk</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cdrom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>floppy</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>lun</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='bus'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>fdc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sata</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </disk>
Jul 25 15:27:31 user nova-compute[70869]:     <graphics supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sdl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vnc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>spice</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egl-headless</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </graphics>
Jul 25 15:27:31 user nova-compute[70869]:     <video supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='modelType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cirrus</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vmvga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>qxl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>none</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>bochs</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ramfb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </video>
Jul 25 15:27:31 user nova-compute[70869]:     <hostdev supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='mode'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>subsystem</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='startupPolicy'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>default</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>mandatory</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>requisite</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>optional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='subsysType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pci</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='capsType'/>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='pciBackend'/>
Jul 25 15:27:31 user nova-compute[70869]:     </hostdev>
Jul 25 15:27:31 user nova-compute[70869]:     <rng supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>random</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egd</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>builtin</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </rng>
Jul 25 15:27:31 user nova-compute[70869]:     <filesystem supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='driverType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>path</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>handle</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtiofs</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </filesystem>
Jul 25 15:27:31 user nova-compute[70869]:     <tpm supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-tis</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-crb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>passthrough</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>emulator</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </tpm>
Jul 25 15:27:31 user nova-compute[70869]:   </devices>
Jul 25 15:27:31 user nova-compute[70869]:   <features>
Jul 25 15:27:31 user nova-compute[70869]:     <gic supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     <vmcoreinfo supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <genid supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backingStoreInput supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backup supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <sev supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:   </features>
Jul 25 15:27:31 user nova-compute[70869]: </domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:  {{(pid=70869) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 25 15:27:31 user nova-compute[70869]: <domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 15:27:31 user nova-compute[70869]:   <domain>kvm</domain>
Jul 25 15:27:31 user nova-compute[70869]:   <machine>pc-i440fx-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:   <arch>x86_64</arch>
Jul 25 15:27:31 user nova-compute[70869]:   <vcpu max='255'/>
Jul 25 15:27:31 user nova-compute[70869]:   <iothreads supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:   <os supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='firmware'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>efi</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:     <loader supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>rom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pflash</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='readonly'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='secure'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </loader>
Jul 25 15:27:31 user nova-compute[70869]:   </os>
Jul 25 15:27:31 user nova-compute[70869]:   <cpu>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-passthrough' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='hostPassthroughMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='maximum' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='maximumMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-model' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <vendor>Intel</vendor>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ss'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='vmx'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pcid'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='hypervisor'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arat'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='umip'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='md-clear'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='invtsc'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibpb'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibrs'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='rsba'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='erms'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='custom' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>qemu64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>qemu32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>phenom</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>n270</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>coreduo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>core2duo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>athlon</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Westmere</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Snowridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Penryn</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G5</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G4</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Opteron_G1</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Nehalem</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Rome</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Milan</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Dhyana</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cooperlake</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Conroe</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>486</model>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:   </cpu>
Jul 25 15:27:31 user nova-compute[70869]:   <memoryBacking supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='sourceType'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>file</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>anonymous</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>memfd</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:   </memoryBacking>
Jul 25 15:27:31 user nova-compute[70869]:   <devices>
Jul 25 15:27:31 user nova-compute[70869]:     <disk supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='diskDevice'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>disk</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cdrom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>floppy</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>lun</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='bus'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ide</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>fdc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sata</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </disk>
Jul 25 15:27:31 user nova-compute[70869]:     <graphics supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sdl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vnc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>spice</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egl-headless</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </graphics>
Jul 25 15:27:31 user nova-compute[70869]:     <video supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='modelType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cirrus</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vmvga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>qxl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>none</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>bochs</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ramfb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </video>
Jul 25 15:27:31 user nova-compute[70869]:     <hostdev supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='mode'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>subsystem</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='startupPolicy'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>default</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>mandatory</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>requisite</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>optional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='subsysType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pci</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='capsType'/>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='pciBackend'/>
Jul 25 15:27:31 user nova-compute[70869]:     </hostdev>
Jul 25 15:27:31 user nova-compute[70869]:     <rng supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>random</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egd</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>builtin</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </rng>
Jul 25 15:27:31 user nova-compute[70869]:     <filesystem supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='driverType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>path</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>handle</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtiofs</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </filesystem>
Jul 25 15:27:31 user nova-compute[70869]:     <tpm supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-tis</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-crb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>passthrough</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>emulator</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </tpm>
Jul 25 15:27:31 user nova-compute[70869]:   </devices>
Jul 25 15:27:31 user nova-compute[70869]:   <features>
Jul 25 15:27:31 user nova-compute[70869]:     <gic supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     <vmcoreinfo supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <genid supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backingStoreInput supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backup supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <sev supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:   </features>
Jul 25 15:27:31 user nova-compute[70869]: </domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:  {{(pid=70869) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 25 15:27:31 user nova-compute[70869]: <domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 15:27:31 user nova-compute[70869]:   <domain>kvm</domain>
Jul 25 15:27:31 user nova-compute[70869]:   <machine>pc-i440fx-6.2</machine>
Jul 25 15:27:31 user nova-compute[70869]:   <arch>x86_64</arch>
Jul 25 15:27:31 user nova-compute[70869]:   <vcpu max='255'/>
Jul 25 15:27:31 user nova-compute[70869]:   <iothreads supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:   <os supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='firmware'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>efi</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:     <loader supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>rom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pflash</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='readonly'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='secure'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </loader>
Jul 25 15:27:31 user nova-compute[70869]:   </os>
Jul 25 15:27:31 user nova-compute[70869]:   <cpu>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-passthrough' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='hostPassthroughMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='maximum' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='maximumMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-model' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <vendor>Intel</vendor>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ss'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='vmx'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pcid'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='hypervisor'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arat'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='umip'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='md-clear'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='invtsc'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibpb'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibrs'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='rsba'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='erms'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='custom' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>qemu64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>qemu32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>phenom</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>n270</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>coreduo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>core2duo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>athlon</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Westmere</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Snowridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Penryn</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G5</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G4</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Opteron_G1</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Nehalem</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Rome</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Milan</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Dhyana</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cooperlake</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Conroe</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>486</model>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:   </cpu>
Jul 25 15:27:31 user nova-compute[70869]:   <memoryBacking supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='sourceType'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>file</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>anonymous</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>memfd</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:   </memoryBacking>
Jul 25 15:27:31 user nova-compute[70869]:   <devices>
Jul 25 15:27:31 user nova-compute[70869]:     <disk supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='diskDevice'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>disk</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cdrom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>floppy</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>lun</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='bus'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ide</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>fdc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sata</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </disk>
Jul 25 15:27:31 user nova-compute[70869]:     <graphics supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sdl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vnc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>spice</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egl-headless</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </graphics>
Jul 25 15:27:31 user nova-compute[70869]:     <video supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='modelType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cirrus</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vmvga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>qxl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>none</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>bochs</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ramfb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </video>
Jul 25 15:27:31 user nova-compute[70869]:     <hostdev supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='mode'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>subsystem</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='startupPolicy'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>default</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>mandatory</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>requisite</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>optional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='subsysType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pci</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='capsType'/>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='pciBackend'/>
Jul 25 15:27:31 user nova-compute[70869]:     </hostdev>
Jul 25 15:27:31 user nova-compute[70869]:     <rng supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>random</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egd</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>builtin</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </rng>
Jul 25 15:27:31 user nova-compute[70869]:     <filesystem supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='driverType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>path</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>handle</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtiofs</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </filesystem>
Jul 25 15:27:31 user nova-compute[70869]:     <tpm supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-tis</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-crb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>passthrough</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>emulator</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </tpm>
Jul 25 15:27:31 user nova-compute[70869]:   </devices>
Jul 25 15:27:31 user nova-compute[70869]:   <features>
Jul 25 15:27:31 user nova-compute[70869]:     <gic supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     <vmcoreinfo supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <genid supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backingStoreInput supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backup supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <sev supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:   </features>
Jul 25 15:27:31 user nova-compute[70869]: </domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:  {{(pid=70869) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 25 15:27:31 user nova-compute[70869]: <domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 25 15:27:31 user nova-compute[70869]:   <domain>kvm</domain>
Jul 25 15:27:31 user nova-compute[70869]:   <machine>pc-q35-jammy</machine>
Jul 25 15:27:31 user nova-compute[70869]:   <arch>x86_64</arch>
Jul 25 15:27:31 user nova-compute[70869]:   <vcpu max='288'/>
Jul 25 15:27:31 user nova-compute[70869]:   <iothreads supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:   <os supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='firmware'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>efi</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:     <loader supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>rom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pflash</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='readonly'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='secure'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>yes</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>no</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </loader>
Jul 25 15:27:31 user nova-compute[70869]:   </os>
Jul 25 15:27:31 user nova-compute[70869]:   <cpu>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-passthrough' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='hostPassthroughMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='maximum' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='maximumMigratable'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>on</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>off</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='host-model' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <vendor>Intel</vendor>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ss'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='vmx'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pcid'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='hypervisor'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arat'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='tsc_adjust'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='umip'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='md-clear'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='arch-capabilities'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='invtsc'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibpb'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='ibrs'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-stibp'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='amd-ssbd'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='rsba'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='require' name='pschange-mc-no'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='erms'/>
Jul 25 15:27:31 user nova-compute[70869]:       <feature policy='disable' name='xsaveopt'/>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:     <mode name='custom' supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>qemu64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>qemu32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>phenom</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>pentium</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>n270</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm64</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>kvm32</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>coreduo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>core2duo</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>athlon</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Westmere-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Westmere</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Snowridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Skylake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>SandyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Penryn</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G5</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G4</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G3</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Opteron_G2</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Opteron_G1</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Nehalem</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>IvyBridge</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Icelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Haswell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Rome</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-Milan</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC-IBPB</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>EPYC</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Dhyana</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cooperlake</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>Conroe</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Cascadelake-Server</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-noTSX</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell-IBRS</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='no'>Broadwell</model>
Jul 25 15:27:31 user nova-compute[70869]:       <model usable='yes'>486</model>
Jul 25 15:27:31 user nova-compute[70869]:     </mode>
Jul 25 15:27:31 user nova-compute[70869]:   </cpu>
Jul 25 15:27:31 user nova-compute[70869]:   <memoryBacking supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:     <enum name='sourceType'>
Jul 25 15:27:31 user nova-compute[70869]:       <value>file</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>anonymous</value>
Jul 25 15:27:31 user nova-compute[70869]:       <value>memfd</value>
Jul 25 15:27:31 user nova-compute[70869]:     </enum>
Jul 25 15:27:31 user nova-compute[70869]:   </memoryBacking>
Jul 25 15:27:31 user nova-compute[70869]:   <devices>
Jul 25 15:27:31 user nova-compute[70869]:     <disk supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='diskDevice'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>disk</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cdrom</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>floppy</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>lun</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='bus'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>fdc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sata</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </disk>
Jul 25 15:27:31 user nova-compute[70869]:     <graphics supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='type'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>sdl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vnc</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>spice</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egl-headless</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </graphics>
Jul 25 15:27:31 user nova-compute[70869]:     <video supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='modelType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>cirrus</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>vmvga</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>qxl</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>none</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>bochs</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>ramfb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </video>
Jul 25 15:27:31 user nova-compute[70869]:     <hostdev supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='mode'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>subsystem</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='startupPolicy'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>default</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>mandatory</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>requisite</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>optional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='subsysType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>usb</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>pci</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>scsi</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='capsType'/>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='pciBackend'/>
Jul 25 15:27:31 user nova-compute[70869]:     </hostdev>
Jul 25 15:27:31 user nova-compute[70869]:     <rng supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtio-non-transitional</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>random</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>egd</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>builtin</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </rng>
Jul 25 15:27:31 user nova-compute[70869]:     <filesystem supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='driverType'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>path</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>handle</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>virtiofs</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </filesystem>
Jul 25 15:27:31 user nova-compute[70869]:     <tpm supported='yes'>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='model'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-tis</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>tpm-crb</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:       <enum name='backendModel'>
Jul 25 15:27:31 user nova-compute[70869]:         <value>passthrough</value>
Jul 25 15:27:31 user nova-compute[70869]:         <value>emulator</value>
Jul 25 15:27:31 user nova-compute[70869]:       </enum>
Jul 25 15:27:31 user nova-compute[70869]:     </tpm>
Jul 25 15:27:31 user nova-compute[70869]:   </devices>
Jul 25 15:27:31 user nova-compute[70869]:   <features>
Jul 25 15:27:31 user nova-compute[70869]:     <gic supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:     <vmcoreinfo supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <genid supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backingStoreInput supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <backup supported='yes'/>
Jul 25 15:27:31 user nova-compute[70869]:     <sev supported='no'/>
Jul 25 15:27:31 user nova-compute[70869]:   </features>
Jul 25 15:27:31 user nova-compute[70869]: </domainCapabilities>
Jul 25 15:27:31 user nova-compute[70869]:  {{(pid=70869) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70869) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70869) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Checking secure boot support for host arch (x86_64) {{(pid=70869) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 25 15:27:31 user nova-compute[70869]: INFO nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Secure Boot support detected
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] cpu compare xml: <cpu match="exact">
Jul 25 15:27:31 user nova-compute[70869]:   <model>Nehalem</model>
Jul 25 15:27:31 user nova-compute[70869]: </cpu>
Jul 25 15:27:31 user nova-compute[70869]:  {{(pid=70869) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 25 15:27:31 user nova-compute[70869]: INFO nova.virt.node [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Generated node identity 42d61115-f6d1-4e6b-8440-2ada622c2cfd
Jul 25 15:27:31 user nova-compute[70869]: INFO nova.virt.node [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Wrote node identity 42d61115-f6d1-4e6b-8440-2ada622c2cfd to /opt/stack/data/nova/compute_id
Jul 25 15:27:31 user nova-compute[70869]: WARNING nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Compute nodes ['42d61115-f6d1-4e6b-8440-2ada622c2cfd'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 25 15:27:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 25 15:27:31 user nova-compute[70869]: WARNING nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 25 15:27:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:27:31 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:27:32 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:27:32 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Hypervisor/Node resource view: name=user free_ram=10918MB free_disk=26.454723358154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:27:32 user nova-compute[70869]: WARNING nova.compute.resource_tracker [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] No compute node record for user:42d61115-f6d1-4e6b-8440-2ada622c2cfd: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 42d61115-f6d1-4e6b-8440-2ada622c2cfd could not be found.
Jul 25 15:27:32 user nova-compute[70869]: INFO nova.compute.resource_tracker [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Compute node record created for user:user with uuid: 42d61115-f6d1-4e6b-8440-2ada622c2cfd
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:27:32 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [req-9eb534f2-c42f-414a-b4e8-9707f5a23fe9] Created resource provider record via placement API for resource provider with UUID 42d61115-f6d1-4e6b-8440-2ada622c2cfd and name user.
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70869) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 25 15:27:32 user nova-compute[70869]: INFO nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] kernel doesn't support AMD SEV
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Libvirt baseline CPU <cpu>
Jul 25 15:27:32 user nova-compute[70869]:   <arch>x86_64</arch>
Jul 25 15:27:32 user nova-compute[70869]:   <model>Nehalem</model>
Jul 25 15:27:32 user nova-compute[70869]:   <vendor>Intel</vendor>
Jul 25 15:27:32 user nova-compute[70869]:   <topology sockets="6" cores="1" threads="1"/>
Jul 25 15:27:32 user nova-compute[70869]: </cpu>
Jul 25 15:27:32 user nova-compute[70869]:  {{(pid=70869) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Updated inventory for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Updating resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd generation from 0 to 1 during operation: update_inventory {{(pid=70869) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Updating resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd generation from 1 to 2 during operation: update_traits {{(pid=70869) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.service [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Creating RPC server for service compute {{(pid=70869) start /opt/stack/nova/nova/service.py:182}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.service [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Join ServiceGroup membership for this service compute {{(pid=70869) start /opt/stack/nova/nova/service.py:199}}
Jul 25 15:27:32 user nova-compute[70869]: DEBUG nova.servicegroup.drivers.db [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70869) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 25 15:27:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_power_states {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:27:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:28:22 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:28:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:28:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:28:23 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=10315MB free_disk=26.358802795410156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:28:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:28:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:28:23 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:28:23 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:28:23 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:28:23 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:28:23 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:28:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:29:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:29:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=10257MB free_disk=26.4080810546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:29:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:29:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:29:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:29:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:29:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:29:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:29:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:29:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:29:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:30:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:30:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:30:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:30:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 15:30:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:30:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:30:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:30:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:30:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:30:24 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:30:25 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:30:25 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:30:25 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=10266MB free_disk=26.180206298828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:30:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:30:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:30:25 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:30:25 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:30:25 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:30:25 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:30:25 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:30:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:30:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:30:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:30:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:30:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:30:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:30:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:30:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:31:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:31:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 15:31:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:25 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:25 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:25 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:31:25 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:25 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:31:26 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:26 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:26 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=9596MB free_disk=26.209575653076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:31:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:26 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:31:26 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:31:26 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:31:26 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:31:26 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:31:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:28 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:28 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:31:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "8beb6a74-a413-4a75-b8ce-678447cff1a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:31:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:31:42 user nova-compute[70869]: INFO nova.compute.claims [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Claim successful on node user
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.300s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:31:42 user nova-compute[70869]: INFO nova.compute.claims [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Claim successful on node user
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.network.neutron [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:31:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:31:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Creating image(s)
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "/opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "/opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "/opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:31:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:31:42 user nova-compute[70869]: DEBUG nova.policy [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47d1f853b9564b8ca6e60577241fed35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50fe153def490bae620115f0dc4b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:31:43 user nova-compute[70869]: INFO nova.compute.claims [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Claim successful on node user
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:31:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Creating image(s)
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "/opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "/opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.policy [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d70372142da4c54a79ce2b0082ac8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608fa31dcdc54e219968ddf70245eb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319.part --force-share --output=json" returned: 0 in 0.123s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.virt.images [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] c7f43ee3-f119-42a6-81e5-b18d0ee6d581 was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319.part /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319.part /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319.converted" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:31:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319.converted --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.075s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:43 user nova-compute[70869]: INFO oslo.privsep.daemon [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9rbqai0y/privsep.sock']
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.829s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:31:43 user sudo[80011]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9rbqai0y/privsep.sock
Jul 25 15:31:43 user sudo[80011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 25 15:31:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:31:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:31:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Creating image(s)
Jul 25 15:31:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "/opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "/opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:44 user nova-compute[70869]: DEBUG nova.policy [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02dfa618b8fc4b06b5e396b7da9e8443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3735c3192f424a8abee7c1874609f005', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:31:45 user sudo[80011]: pam_unix(sudo:session): session closed for user root
Jul 25 15:31:45 user nova-compute[70869]: INFO oslo.privsep.daemon [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Spawned new privsep daemon via rootwrap
Jul 25 15:31:45 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 25 15:31:45 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 25 15:31:45 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 25 15:31:45 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80014
Jul 25 15:31:45 user nova-compute[70869]: WARNING oslo_privsep.priv_context [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] privsep daemon already running
Jul 25 15:31:45 user nova-compute[70869]: WARNING oslo_privsep.priv_context [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] privsep daemon already running
Jul 25 15:31:45 user nova-compute[70869]: DEBUG nova.network.neutron [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Successfully created port: 8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.130s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.119s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.128s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk 1073741824" returned: 0 in 0.041s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.166s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk 1073741824" returned: 0 in 0.047s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.369s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Cannot resize image /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lazy-loading 'migration_context' on Instance uuid 8beb6a74-a413-4a75-b8ce-678447cff1a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Ensure instance console log exists: /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.118s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.124s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Successfully created port: 20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk 1073741824" returned: 0 in 0.040s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Cannot resize image /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lazy-loading 'migration_context' on Instance uuid bb1bf680-5ab7-4210-b3d1-44fe0775a9ca {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Ensure instance console log exists: /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.120s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Cannot resize image /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'migration_context' on Instance uuid 5ce85315-be2f-4be3-953f-ed7b5d4685d6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Ensure instance console log exists: /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Successfully created port: 77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:31:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Successfully updated port: 8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:31:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquired lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:31:49 user nova-compute[70869]: INFO nova.compute.claims [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Claim successful on node user
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-aa7b1852-535d-46f3-b298-e17ba42d5281 req-a5cad68f-e484-4d96-9ab9-cdabe4b60548 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received event network-changed-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-aa7b1852-535d-46f3-b298-e17ba42d5281 req-a5cad68f-e484-4d96-9ab9-cdabe4b60548 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Refreshing instance network info cache due to event network-changed-8a556969-3c2f-410a-ac20-29e261e06c2a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aa7b1852-535d-46f3-b298-e17ba42d5281 req-a5cad68f-e484-4d96-9ab9-cdabe4b60548 service nova] Acquiring lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Successfully updated port: 77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "refresh_cache-bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquired lock "refresh_cache-bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:31:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-2cfb45d6-8d3a-4b7a-902e-485fa3b9ded2 req-0f77260c-29da-47f3-95c2-8ac259a4c688 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received event network-changed-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-2cfb45d6-8d3a-4b7a-902e-485fa3b9ded2 req-0f77260c-29da-47f3-95c2-8ac259a4c688 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Refreshing instance network info cache due to event network-changed-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2cfb45d6-8d3a-4b7a-902e-485fa3b9ded2 req-0f77260c-29da-47f3-95c2-8ac259a4c688 service nova] Acquiring lock "refresh_cache-bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Successfully updated port: 20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:31:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Creating image(s)
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquired lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:31:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.network.neutron [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk 1073741824" returned: 0 in 0.046s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.policy [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b78b568f3a4845f081f3ceceb051ada0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3780103999341dfa03d761707294bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:31:50 user nova-compute[70869]: INFO nova.compute.claims [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Claim successful on node user
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.network.neutron [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Updating instance_info_cache with network_info: [{"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Cannot resize image /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'migration_context' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Releasing lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Instance network_info: |[{"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Ensure instance console log exists: /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aa7b1852-535d-46f3-b298-e17ba42d5281 req-a5cad68f-e484-4d96-9ab9-cdabe4b60548 service nova] Acquired lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-aa7b1852-535d-46f3-b298-e17ba42d5281 req-a5cad68f-e484-4d96-9ab9-cdabe4b60548 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Refreshing network info cache for port 8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Start _get_guest_xml network_info=[{"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:31:50 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:50 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1235736738',display_name='tempest-ServersNegativeTestJSON-server-1235736738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1235736738',id=2,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e50fe153def490bae620115f0dc4b50',ramdisk_id='',reservation_id='r-mwym1ych',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-454996836',owner_user_name='tempest-ServersNegativeTestJSON-454996836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:43Z,user_data=None,user_id='47d1f853b9564b8ca6e60577241fed35',uuid=8beb6a74-a413-4a75-b8ce-678447cff1a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converting VIF {"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ac:d2,bridge_name='br-int',has_traffic_filtering=True,id=8a556969-3c2f-410a-ac20-29e261e06c2a,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a556969-3c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.objects.instance [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lazy-loading 'pci_devices' on Instance uuid 8beb6a74-a413-4a75-b8ce-678447cff1a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:31:50 user nova-compute[70869]:   <uuid>8beb6a74-a413-4a75-b8ce-678447cff1a5</uuid>
Jul 25 15:31:50 user nova-compute[70869]:   <name>instance-00000002</name>
Jul 25 15:31:50 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:31:50 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:31:50 user nova-compute[70869]:   <metadata>
Jul 25 15:31:50 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:31:50 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:31:50 user nova-compute[70869]:       <nova:name>tempest-ServersNegativeTestJSON-server-1235736738</nova:name>
Jul 25 15:31:50 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:31:50</nova:creationTime>
Jul 25 15:31:50 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:31:50 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:31:50 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:31:50 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:31:50 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:31:50 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:31:50 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:31:50 user nova-compute[70869]:       <nova:owner>
Jul 25 15:31:50 user nova-compute[70869]:         <nova:user uuid="47d1f853b9564b8ca6e60577241fed35">tempest-ServersNegativeTestJSON-454996836-project-member</nova:user>
Jul 25 15:31:50 user nova-compute[70869]:         <nova:project uuid="5e50fe153def490bae620115f0dc4b50">tempest-ServersNegativeTestJSON-454996836</nova:project>
Jul 25 15:31:50 user nova-compute[70869]:       </nova:owner>
Jul 25 15:31:50 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:31:50 user nova-compute[70869]:       <nova:ports>
Jul 25 15:31:50 user nova-compute[70869]:         <nova:port uuid="8a556969-3c2f-410a-ac20-29e261e06c2a">
Jul 25 15:31:50 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 15:31:50 user nova-compute[70869]:         </nova:port>
Jul 25 15:31:50 user nova-compute[70869]:       </nova:ports>
Jul 25 15:31:50 user nova-compute[70869]:     </nova:instance>
Jul 25 15:31:50 user nova-compute[70869]:   </metadata>
Jul 25 15:31:50 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:31:50 user nova-compute[70869]:     <system>
Jul 25 15:31:50 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:31:50 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:31:50 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:31:50 user nova-compute[70869]:       <entry name="serial">8beb6a74-a413-4a75-b8ce-678447cff1a5</entry>
Jul 25 15:31:50 user nova-compute[70869]:       <entry name="uuid">8beb6a74-a413-4a75-b8ce-678447cff1a5</entry>
Jul 25 15:31:50 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:31:50 user nova-compute[70869]:     </system>
Jul 25 15:31:50 user nova-compute[70869]:   </sysinfo>
Jul 25 15:31:50 user nova-compute[70869]:   <os>
Jul 25 15:31:50 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:31:50 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:31:50 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:31:50 user nova-compute[70869]:   </os>
Jul 25 15:31:50 user nova-compute[70869]:   <features>
Jul 25 15:31:50 user nova-compute[70869]:     <acpi/>
Jul 25 15:31:50 user nova-compute[70869]:     <apic/>
Jul 25 15:31:50 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:31:50 user nova-compute[70869]:   </features>
Jul 25 15:31:50 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:31:50 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:31:50 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:31:50 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:31:50 user nova-compute[70869]:   </clock>
Jul 25 15:31:50 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:31:50 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:31:50 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:31:50 user nova-compute[70869]:   </cpu>
Jul 25 15:31:50 user nova-compute[70869]:   <devices>
Jul 25 15:31:50 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:31:50 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:31:50 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk"/>
Jul 25 15:31:50 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:31:50 user nova-compute[70869]:     </disk>
Jul 25 15:31:50 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:31:50 user nova-compute[70869]:       <mac address="fa:16:3e:1c:ac:d2"/>
Jul 25 15:31:50 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:50 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:31:50 user nova-compute[70869]:       <target dev="tap8a556969-3c"/>
Jul 25 15:31:50 user nova-compute[70869]:     </interface>
Jul 25 15:31:50 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:31:50 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/console.log" append="off"/>
Jul 25 15:31:50 user nova-compute[70869]:     </serial>
Jul 25 15:31:50 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:31:50 user nova-compute[70869]:     <video>
Jul 25 15:31:50 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:50 user nova-compute[70869]:     </video>
Jul 25 15:31:50 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:31:50 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:31:50 user nova-compute[70869]:     </rng>
Jul 25 15:31:50 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:31:50 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:31:50 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:31:50 user nova-compute[70869]:     </memballoon>
Jul 25 15:31:50 user nova-compute[70869]:   </devices>
Jul 25 15:31:50 user nova-compute[70869]: </domain>
Jul 25 15:31:50 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1235736738',display_name='tempest-ServersNegativeTestJSON-server-1235736738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1235736738',id=2,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e50fe153def490bae620115f0dc4b50',ramdisk_id='',reservation_id='r-mwym1ych',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-454996836',owner_user_name='tempest-ServersNegativeTestJSON-454996836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:43Z,user_data=None,user_id='47d1f853b9564b8ca6e60577241fed35',uuid=8beb6a74-a413-4a75-b8ce-678447cff1a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converting VIF {"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ac:d2,bridge_name='br-int',has_traffic_filtering=True,id=8a556969-3c2f-410a-ac20-29e261e06c2a,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a556969-3c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG os_vif [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ac:d2,bridge_name='br-int',has_traffic_filtering=True,id=8a556969-3c2f-410a-ac20-29e261e06c2a,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a556969-3c') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Created schema index Interface.name {{(pid=70869) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Created schema index Port.name {{(pid=70869) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Created schema index Bridge.name {{(pid=70869) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [POLLOUT] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:31:50 user nova-compute[70869]: INFO oslo.privsep.daemon [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp7377ydyd/privsep.sock']
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:50 user sudo[80080]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp7377ydyd/privsep.sock
Jul 25 15:31:50 user sudo[80080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 25 15:31:50 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:31:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.134s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:31:51 user nova-compute[70869]: INFO nova.compute.claims [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Claim successful on node user
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:31:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Updating instance_info_cache with network_info: [{"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Releasing lock "refresh_cache-bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Instance network_info: |[{"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2cfb45d6-8d3a-4b7a-902e-485fa3b9ded2 req-0f77260c-29da-47f3-95c2-8ac259a4c688 service nova] Acquired lock "refresh_cache-bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.neutron [req-2cfb45d6-8d3a-4b7a-902e-485fa3b9ded2 req-0f77260c-29da-47f3-95c2-8ac259a4c688 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Refreshing network info cache for port 77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Start _get_guest_xml network_info=[{"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:31:51 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:51 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-466458426',display_name='tempest-DeleteServersTestJSON-server-466458426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-466458426',id=1,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='608fa31dcdc54e219968ddf70245eb4e',ramdisk_id='',reservation_id='r-inj6krl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1412196701',owner_user_name='tempest-DeleteServersTestJSON-1412196701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:43Z,user_data=None,user_id='6d70372142da4c54a79ce2b0082ac8cc',uuid=bb1bf680-5ab7-4210-b3d1-44fe0775a9ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Converting VIF {"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:31:d0,bridge_name='br-int',has_traffic_filtering=True,id=77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf,network=Network(b9590cf0-eeff-45f6-bb79-743833a7a38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77aff25d-6e') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lazy-loading 'pci_devices' on Instance uuid bb1bf680-5ab7-4210-b3d1-44fe0775a9ca {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:31:51 user nova-compute[70869]:   <uuid>bb1bf680-5ab7-4210-b3d1-44fe0775a9ca</uuid>
Jul 25 15:31:51 user nova-compute[70869]:   <name>instance-00000001</name>
Jul 25 15:31:51 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:31:51 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:31:51 user nova-compute[70869]:   <metadata>
Jul 25 15:31:51 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:31:51 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:name>tempest-DeleteServersTestJSON-server-466458426</nova:name>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:31:51</nova:creationTime>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:31:51 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:31:51 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:owner>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:user uuid="6d70372142da4c54a79ce2b0082ac8cc">tempest-DeleteServersTestJSON-1412196701-project-member</nova:user>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:project uuid="608fa31dcdc54e219968ddf70245eb4e">tempest-DeleteServersTestJSON-1412196701</nova:project>
Jul 25 15:31:51 user nova-compute[70869]:       </nova:owner>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:ports>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:port uuid="77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf">
Jul 25 15:31:51 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 15:31:51 user nova-compute[70869]:         </nova:port>
Jul 25 15:31:51 user nova-compute[70869]:       </nova:ports>
Jul 25 15:31:51 user nova-compute[70869]:     </nova:instance>
Jul 25 15:31:51 user nova-compute[70869]:   </metadata>
Jul 25 15:31:51 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:31:51 user nova-compute[70869]:     <system>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="serial">bb1bf680-5ab7-4210-b3d1-44fe0775a9ca</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="uuid">bb1bf680-5ab7-4210-b3d1-44fe0775a9ca</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:31:51 user nova-compute[70869]:     </system>
Jul 25 15:31:51 user nova-compute[70869]:   </sysinfo>
Jul 25 15:31:51 user nova-compute[70869]:   <os>
Jul 25 15:31:51 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:31:51 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:31:51 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:31:51 user nova-compute[70869]:   </os>
Jul 25 15:31:51 user nova-compute[70869]:   <features>
Jul 25 15:31:51 user nova-compute[70869]:     <acpi/>
Jul 25 15:31:51 user nova-compute[70869]:     <apic/>
Jul 25 15:31:51 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:31:51 user nova-compute[70869]:   </features>
Jul 25 15:31:51 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:31:51 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:31:51 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:31:51 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:31:51 user nova-compute[70869]:   </clock>
Jul 25 15:31:51 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:31:51 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:31:51 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:31:51 user nova-compute[70869]:   </cpu>
Jul 25 15:31:51 user nova-compute[70869]:   <devices>
Jul 25 15:31:51 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:31:51 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:31:51 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk"/>
Jul 25 15:31:51 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:31:51 user nova-compute[70869]:     </disk>
Jul 25 15:31:51 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:31:51 user nova-compute[70869]:       <mac address="fa:16:3e:d7:31:d0"/>
Jul 25 15:31:51 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:51 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:31:51 user nova-compute[70869]:       <target dev="tap77aff25d-6e"/>
Jul 25 15:31:51 user nova-compute[70869]:     </interface>
Jul 25 15:31:51 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:31:51 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/console.log" append="off"/>
Jul 25 15:31:51 user nova-compute[70869]:     </serial>
Jul 25 15:31:51 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:31:51 user nova-compute[70869]:     <video>
Jul 25 15:31:51 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:51 user nova-compute[70869]:     </video>
Jul 25 15:31:51 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:31:51 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:31:51 user nova-compute[70869]:     </rng>
Jul 25 15:31:51 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:31:51 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:31:51 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:31:51 user nova-compute[70869]:     </memballoon>
Jul 25 15:31:51 user nova-compute[70869]:   </devices>
Jul 25 15:31:51 user nova-compute[70869]: </domain>
Jul 25 15:31:51 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-466458426',display_name='tempest-DeleteServersTestJSON-server-466458426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-466458426',id=1,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='608fa31dcdc54e219968ddf70245eb4e',ramdisk_id='',reservation_id='r-inj6krl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1412196701',owner_user_name='tempest-DeleteServersTestJSON-1412196701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:43Z,user_data=None,user_id='6d70372142da4c54a79ce2b0082ac8cc',uuid=bb1bf680-5ab7-4210-b3d1-44fe0775a9ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Converting VIF {"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:31:d0,bridge_name='br-int',has_traffic_filtering=True,id=77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf,network=Network(b9590cf0-eeff-45f6-bb79-743833a7a38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77aff25d-6e') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG os_vif [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:31:d0,bridge_name='br-int',has_traffic_filtering=True,id=77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf,network=Network(b9590cf0-eeff-45f6-bb79-743833a7a38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77aff25d-6e') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:31:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Creating image(s)
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.neutron [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk 1073741824" returned: 0 in 0.049s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-bc46973f-92d4-475c-8b2a-f3456dcbef14 req-2760344e-0063-4a6b-858e-8466674ed8a3 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received event network-changed-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-bc46973f-92d4-475c-8b2a-f3456dcbef14 req-2760344e-0063-4a6b-858e-8466674ed8a3 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Refreshing instance network info cache due to event network-changed-20104704-4c49-4860-95d3-64fe55afc3b3. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bc46973f-92d4-475c-8b2a-f3456dcbef14 req-2760344e-0063-4a6b-858e-8466674ed8a3 service nova] Acquiring lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.policy [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d09efb7dac2429a97ec41381705c5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52ab59c5e0a442aa53ad1edd6b4ec5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.122s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.neutron [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updating instance_info_cache with network_info: [{"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Releasing lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Instance network_info: |[{"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bc46973f-92d4-475c-8b2a-f3456dcbef14 req-2760344e-0063-4a6b-858e-8466674ed8a3 service nova] Acquired lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.neutron [req-bc46973f-92d4-475c-8b2a-f3456dcbef14 req-2760344e-0063-4a6b-858e-8466674ed8a3 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Refreshing network info cache for port 20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Start _get_guest_xml network_info=[{"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:31:51 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:51 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2040073500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2040073500',id=3,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-xexi98s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:44Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=5ce85315-be2f-4be3-953f-ed7b5d4685d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:99:b6,bridge_name='br-int',has_traffic_filtering=True,id=20104704-4c49-4860-95d3-64fe55afc3b3,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20104704-4c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ce85315-be2f-4be3-953f-ed7b5d4685d6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:31:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Creating image(s)
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "/opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "/opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:31:51 user nova-compute[70869]:   <uuid>5ce85315-be2f-4be3-953f-ed7b5d4685d6</uuid>
Jul 25 15:31:51 user nova-compute[70869]:   <name>instance-00000003</name>
Jul 25 15:31:51 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:31:51 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:31:51 user nova-compute[70869]:   <metadata>
Jul 25 15:31:51 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:31:51 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2040073500</nova:name>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:31:51</nova:creationTime>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:31:51 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:31:51 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:owner>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:user uuid="02dfa618b8fc4b06b5e396b7da9e8443">tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member</nova:user>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:project uuid="3735c3192f424a8abee7c1874609f005">tempest-ServerBootFromVolumeStableRescueTest-508290498</nova:project>
Jul 25 15:31:51 user nova-compute[70869]:       </nova:owner>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:31:51 user nova-compute[70869]:       <nova:ports>
Jul 25 15:31:51 user nova-compute[70869]:         <nova:port uuid="20104704-4c49-4860-95d3-64fe55afc3b3">
Jul 25 15:31:51 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 15:31:51 user nova-compute[70869]:         </nova:port>
Jul 25 15:31:51 user nova-compute[70869]:       </nova:ports>
Jul 25 15:31:51 user nova-compute[70869]:     </nova:instance>
Jul 25 15:31:51 user nova-compute[70869]:   </metadata>
Jul 25 15:31:51 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:31:51 user nova-compute[70869]:     <system>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="serial">5ce85315-be2f-4be3-953f-ed7b5d4685d6</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="uuid">5ce85315-be2f-4be3-953f-ed7b5d4685d6</entry>
Jul 25 15:31:51 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:31:51 user nova-compute[70869]:     </system>
Jul 25 15:31:51 user nova-compute[70869]:   </sysinfo>
Jul 25 15:31:51 user nova-compute[70869]:   <os>
Jul 25 15:31:51 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:31:51 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:31:51 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:31:51 user nova-compute[70869]:   </os>
Jul 25 15:31:51 user nova-compute[70869]:   <features>
Jul 25 15:31:51 user nova-compute[70869]:     <acpi/>
Jul 25 15:31:51 user nova-compute[70869]:     <apic/>
Jul 25 15:31:51 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:31:51 user nova-compute[70869]:   </features>
Jul 25 15:31:51 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:31:51 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:31:51 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:31:51 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:31:51 user nova-compute[70869]:   </clock>
Jul 25 15:31:51 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:31:51 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:31:51 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:31:51 user nova-compute[70869]:   </cpu>
Jul 25 15:31:51 user nova-compute[70869]:   <devices>
Jul 25 15:31:51 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:31:51 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:31:51 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk"/>
Jul 25 15:31:51 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:31:51 user nova-compute[70869]:     </disk>
Jul 25 15:31:51 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:31:51 user nova-compute[70869]:       <mac address="fa:16:3e:7e:99:b6"/>
Jul 25 15:31:51 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:51 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:31:51 user nova-compute[70869]:       <target dev="tap20104704-4c"/>
Jul 25 15:31:51 user nova-compute[70869]:     </interface>
Jul 25 15:31:51 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:31:51 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/console.log" append="off"/>
Jul 25 15:31:51 user nova-compute[70869]:     </serial>
Jul 25 15:31:51 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:31:51 user nova-compute[70869]:     <video>
Jul 25 15:31:51 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:51 user nova-compute[70869]:     </video>
Jul 25 15:31:51 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:31:51 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:31:51 user nova-compute[70869]:     </rng>
Jul 25 15:31:51 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:31:51 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:31:51 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:31:51 user nova-compute[70869]:     </memballoon>
Jul 25 15:31:51 user nova-compute[70869]:   </devices>
Jul 25 15:31:51 user nova-compute[70869]: </domain>
Jul 25 15:31:51 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2040073500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2040073500',id=3,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-xexi98s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:44Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=5ce85315-be2f-4be3-953f-ed7b5d4685d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:99:b6,bridge_name='br-int',has_traffic_filtering=True,id=20104704-4c49-4860-95d3-64fe55afc3b3,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20104704-4c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG os_vif [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:99:b6,bridge_name='br-int',has_traffic_filtering=True,id=20104704-4c49-4860-95d3-64fe55afc3b3,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20104704-4c') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Cannot resize image /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:31:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'migration_context' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Ensure instance console log exists: /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.124s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.policy [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0d6af7f176145f382a7cc839ed2c027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d4e6ad84894e2d8ca5aee1aa77db4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.125s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk 1073741824" returned: 0 in 0.045s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:52 user sudo[80080]: pam_unix(sudo:session): session closed for user root
Jul 25 15:31:52 user nova-compute[70869]: INFO oslo.privsep.daemon [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Spawned new privsep daemon via rootwrap
Jul 25 15:31:52 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 25 15:31:52 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 25 15:31:52 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 25 15:31:52 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80150
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.176s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:31:52 user nova-compute[70869]: WARNING oslo_privsep.priv_context [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] privsep daemon already running
Jul 25 15:31:52 user nova-compute[70869]: WARNING oslo_privsep.priv_context [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] privsep daemon already running
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Cannot resize image /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.objects.instance [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'migration_context' on Instance uuid c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Ensure instance console log exists: /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.network.neutron [req-aa7b1852-535d-46f3-b298-e17ba42d5281 req-a5cad68f-e484-4d96-9ab9-cdabe4b60548 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Updated VIF entry in instance network info cache for port 8a556969-3c2f-410a-ac20-29e261e06c2a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.network.neutron [req-aa7b1852-535d-46f3-b298-e17ba42d5281 req-a5cad68f-e484-4d96-9ab9-cdabe4b60548 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Updating instance_info_cache with network_info: [{"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aa7b1852-535d-46f3-b298-e17ba42d5281 req-a5cad68f-e484-4d96-9ab9-cdabe4b60548 service nova] Releasing lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.network.neutron [req-2cfb45d6-8d3a-4b7a-902e-485fa3b9ded2 req-0f77260c-29da-47f3-95c2-8ac259a4c688 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Updated VIF entry in instance network info cache for port 77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.network.neutron [req-2cfb45d6-8d3a-4b7a-902e-485fa3b9ded2 req-0f77260c-29da-47f3-95c2-8ac259a4c688 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Updating instance_info_cache with network_info: [{"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2cfb45d6-8d3a-4b7a-902e-485fa3b9ded2 req-0f77260c-29da-47f3-95c2-8ac259a4c688 service nova] Releasing lock "refresh_cache-bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20104704-4c, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20104704-4c, col_values=(('external_ids', {'iface-id': '20104704-4c49-4860-95d3-64fe55afc3b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:99:b6', 'vm-uuid': '5ce85315-be2f-4be3-953f-ed7b5d4685d6'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:52 user nova-compute[70869]: INFO os_vif [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:99:b6,bridge_name='br-int',has_traffic_filtering=True,id=20104704-4c49-4860-95d3-64fe55afc3b3,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20104704-4c')
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a556969-3c, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a556969-3c, col_values=(('external_ids', {'iface-id': '8a556969-3c2f-410a-ac20-29e261e06c2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:ac:d2', 'vm-uuid': '8beb6a74-a413-4a75-b8ce-678447cff1a5'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:52 user nova-compute[70869]: INFO os_vif [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ac:d2,bridge_name='br-int',has_traffic_filtering=True,id=8a556969-3c2f-410a-ac20-29e261e06c2a,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a556969-3c')
Jul 25 15:31:52 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Successfully created port: b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77aff25d-6e, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77aff25d-6e, col_values=(('external_ids', {'iface-id': '77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:31:d0', 'vm-uuid': 'bb1bf680-5ab7-4210-b3d1-44fe0775a9ca'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:53 user nova-compute[70869]: INFO os_vif [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:31:d0,bridge_name='br-int',has_traffic_filtering=True,id=77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf,network=Network(b9590cf0-eeff-45f6-bb79-743833a7a38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77aff25d-6e')
Jul 25 15:31:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No VIF found with MAC fa:16:3e:7e:99:b6, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] No VIF found with MAC fa:16:3e:1c:ac:d2, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] No VIF found with MAC fa:16:3e:d7:31:d0, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG nova.network.neutron [req-bc46973f-92d4-475c-8b2a-f3456dcbef14 req-2760344e-0063-4a6b-858e-8466674ed8a3 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updated VIF entry in instance network info cache for port 20104704-4c49-4860-95d3-64fe55afc3b3. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG nova.network.neutron [req-bc46973f-92d4-475c-8b2a-f3456dcbef14 req-2760344e-0063-4a6b-858e-8466674ed8a3 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updating instance_info_cache with network_info: [{"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bc46973f-92d4-475c-8b2a-f3456dcbef14 req-2760344e-0063-4a6b-858e-8466674ed8a3 service nova] Releasing lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:54 user nova-compute[70869]: DEBUG nova.network.neutron [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Successfully created port: 2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:31:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:54 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Successfully created port: b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:31:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Successfully updated port: b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquired lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-e5a828de-e834-456c-ae92-6056ad88ecda req-6c49ae04-756e-498f-9c7a-ed35233bceae service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-changed-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-e5a828de-e834-456c-ae92-6056ad88ecda req-6c49ae04-756e-498f-9c7a-ed35233bceae service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Refreshing instance network info cache due to event network-changed-b512c720-cc12-4cbd-98b1-62b64bc2a752. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e5a828de-e834-456c-ae92-6056ad88ecda req-6c49ae04-756e-498f-9c7a-ed35233bceae service nova] Acquiring lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-332eec7e-bb15-4a0f-9ea0-b33cf529428a req-a0c8cf29-34ed-45b2-a518-46b4c91915f5 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received event network-vif-plugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-332eec7e-bb15-4a0f-9ea0-b33cf529428a req-a0c8cf29-34ed-45b2-a518-46b4c91915f5 service nova] Acquiring lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-332eec7e-bb15-4a0f-9ea0-b33cf529428a req-a0c8cf29-34ed-45b2-a518-46b4c91915f5 service nova] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-332eec7e-bb15-4a0f-9ea0-b33cf529428a req-a0c8cf29-34ed-45b2-a518-46b4c91915f5 service nova] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-332eec7e-bb15-4a0f-9ea0-b33cf529428a req-a0c8cf29-34ed-45b2-a518-46b4c91915f5 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] No waiting events found dispatching network-vif-plugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:31:56 user nova-compute[70869]: WARNING nova.compute.manager [req-332eec7e-bb15-4a0f-9ea0-b33cf529428a req-a0c8cf29-34ed-45b2-a518-46b4c91915f5 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received unexpected event network-vif-plugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf for instance with vm_state building and task_state spawning.
Jul 25 15:31:56 user nova-compute[70869]: DEBUG nova.network.neutron [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Successfully updated port: 2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquired lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG nova.network.neutron [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG nova.network.neutron [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:31:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating instance_info_cache with network_info: [{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Releasing lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Instance network_info: |[{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e5a828de-e834-456c-ae92-6056ad88ecda req-6c49ae04-756e-498f-9c7a-ed35233bceae service nova] Acquired lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.neutron [req-e5a828de-e834-456c-ae92-6056ad88ecda req-6c49ae04-756e-498f-9c7a-ed35233bceae service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Refreshing network info cache for port b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Start _get_guest_xml network_info=[{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.neutron [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Updating instance_info_cache with network_info: [{"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:57 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:57 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Releasing lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Instance network_info: |[{"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Start _get_guest_xml network_info=[{"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-784113893',display_name='tempest-ServerStableDeviceRescueTest-server-784113893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-784113893',id=4,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZWkhEQZxma12rR0Om4x7WfDpt9pkLgXCaUDIjtRJgMe9oRuMvxIcGNqAesWThKH7m+GTrLgb/QUJ6B9QTZKJwX9sDX9n9SktFLsQ1Vx0ZmhGg8z7/yAeym8MbDarhpiw==',key_name='tempest-keypair-1975963349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3780103999341dfa03d761707294bbd',ramdisk_id='',reservation_id='r-kjuq3luj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-464827475',owner_user_name='tempest-ServerStableDeviceRescueTest-464827475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78b568f3a4845f081f3ceceb051ada0',uuid=fa170559-5228-448f-acea-c5b816a22631,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Converting VIF {"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=b512c720-cc12-4cbd-98b1-62b64bc2a752,network=Network(947170b3-5f57-43a6-a8a1-c3d4ae38a0e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb512c720-cc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'pci_devices' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:57 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:31:57 user nova-compute[70869]:   <uuid>fa170559-5228-448f-acea-c5b816a22631</uuid>
Jul 25 15:31:57 user nova-compute[70869]:   <name>instance-00000004</name>
Jul 25 15:31:57 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:31:57 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:31:57 user nova-compute[70869]:   <metadata>
Jul 25 15:31:57 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:31:57 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-784113893</nova:name>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:31:57</nova:creationTime>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:31:57 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:31:57 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:owner>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:user uuid="b78b568f3a4845f081f3ceceb051ada0">tempest-ServerStableDeviceRescueTest-464827475-project-member</nova:user>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:project uuid="e3780103999341dfa03d761707294bbd">tempest-ServerStableDeviceRescueTest-464827475</nova:project>
Jul 25 15:31:57 user nova-compute[70869]:       </nova:owner>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:ports>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:port uuid="b512c720-cc12-4cbd-98b1-62b64bc2a752">
Jul 25 15:31:57 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 15:31:57 user nova-compute[70869]:         </nova:port>
Jul 25 15:31:57 user nova-compute[70869]:       </nova:ports>
Jul 25 15:31:57 user nova-compute[70869]:     </nova:instance>
Jul 25 15:31:57 user nova-compute[70869]:   </metadata>
Jul 25 15:31:57 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:31:57 user nova-compute[70869]:     <system>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="serial">fa170559-5228-448f-acea-c5b816a22631</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="uuid">fa170559-5228-448f-acea-c5b816a22631</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:31:57 user nova-compute[70869]:     </system>
Jul 25 15:31:57 user nova-compute[70869]:   </sysinfo>
Jul 25 15:31:57 user nova-compute[70869]:   <os>
Jul 25 15:31:57 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:31:57 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:31:57 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:31:57 user nova-compute[70869]:   </os>
Jul 25 15:31:57 user nova-compute[70869]:   <features>
Jul 25 15:31:57 user nova-compute[70869]:     <acpi/>
Jul 25 15:31:57 user nova-compute[70869]:     <apic/>
Jul 25 15:31:57 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:31:57 user nova-compute[70869]:   </features>
Jul 25 15:31:57 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:31:57 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:31:57 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:31:57 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:31:57 user nova-compute[70869]:   </clock>
Jul 25 15:31:57 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:31:57 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:31:57 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:31:57 user nova-compute[70869]:   </cpu>
Jul 25 15:31:57 user nova-compute[70869]:   <devices>
Jul 25 15:31:57 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:31:57 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:31:57 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk"/>
Jul 25 15:31:57 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:31:57 user nova-compute[70869]:     </disk>
Jul 25 15:31:57 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:31:57 user nova-compute[70869]:       <mac address="fa:16:3e:30:bc:ad"/>
Jul 25 15:31:57 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:57 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:31:57 user nova-compute[70869]:       <target dev="tapb512c720-cc"/>
Jul 25 15:31:57 user nova-compute[70869]:     </interface>
Jul 25 15:31:57 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:31:57 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/console.log" append="off"/>
Jul 25 15:31:57 user nova-compute[70869]:     </serial>
Jul 25 15:31:57 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:31:57 user nova-compute[70869]:     <video>
Jul 25 15:31:57 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:57 user nova-compute[70869]:     </video>
Jul 25 15:31:57 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:31:57 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:31:57 user nova-compute[70869]:     </rng>
Jul 25 15:31:57 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:31:57 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:31:57 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:31:57 user nova-compute[70869]:     </memballoon>
Jul 25 15:31:57 user nova-compute[70869]:   </devices>
Jul 25 15:31:57 user nova-compute[70869]: </domain>
Jul 25 15:31:57 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-784113893',display_name='tempest-ServerStableDeviceRescueTest-server-784113893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-784113893',id=4,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZWkhEQZxma12rR0Om4x7WfDpt9pkLgXCaUDIjtRJgMe9oRuMvxIcGNqAesWThKH7m+GTrLgb/QUJ6B9QTZKJwX9sDX9n9SktFLsQ1Vx0ZmhGg8z7/yAeym8MbDarhpiw==',key_name='tempest-keypair-1975963349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3780103999341dfa03d761707294bbd',ramdisk_id='',reservation_id='r-kjuq3luj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-464827475',owner_user_name='tempest-ServerStableDeviceRescueTest-464827475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78b568f3a4845f081f3ceceb051ada0',uuid=fa170559-5228-448f-acea-c5b816a22631,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Converting VIF {"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=b512c720-cc12-4cbd-98b1-62b64bc2a752,network=Network(947170b3-5f57-43a6-a8a1-c3d4ae38a0e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb512c720-cc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG os_vif [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=b512c720-cc12-4cbd-98b1-62b64bc2a752,network=Network(947170b3-5f57-43a6-a8a1-c3d4ae38a0e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb512c720-cc') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb512c720-cc, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb512c720-cc, col_values=(('external_ids', {'iface-id': 'b512c720-cc12-4cbd-98b1-62b64bc2a752', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:bc:ad', 'vm-uuid': 'fa170559-5228-448f-acea-c5b816a22631'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-679150226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-679150226',id=6,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd5ruZaws+3RLrARdKgK3cmlipmHN2NhoKSEL2XI1JlqdOPd5N5x9NV4Ofw/kMNgySHUP1LDOJI7s2MoBufg2/4aflCz0SM6ZcsFLhQtZmMGazc86LsU1BaJroeb181pA==',key_name='tempest-keypair-252354925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27d4e6ad84894e2d8ca5aee1aa77db4e',ramdisk_id='',reservation_id='r-hujuwjkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1601506810',owner_user_name='tempest-ServerActionsV293TestJSON-1601506810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0d6af7f176145f382a7cc839ed2c027',uuid=c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converting VIF {"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:8e,bridge_name='br-int',has_traffic_filtering=True,id=2606ef46-4806-4296-b081-1e354878db1f,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2606ef46-48') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.objects.instance [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'pci_devices' on Instance uuid c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e216394-2312-45a2-a1ab-6f86af012d36 req-226b4fa5-0b78-498f-85c3-65b29782dff1 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received event network-vif-plugged-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e216394-2312-45a2-a1ab-6f86af012d36 req-226b4fa5-0b78-498f-85c3-65b29782dff1 service nova] Acquiring lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e216394-2312-45a2-a1ab-6f86af012d36 req-226b4fa5-0b78-498f-85c3-65b29782dff1 service nova] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e216394-2312-45a2-a1ab-6f86af012d36 req-226b4fa5-0b78-498f-85c3-65b29782dff1 service nova] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e216394-2312-45a2-a1ab-6f86af012d36 req-226b4fa5-0b78-498f-85c3-65b29782dff1 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] No waiting events found dispatching network-vif-plugged-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:31:57 user nova-compute[70869]: WARNING nova.compute.manager [req-0e216394-2312-45a2-a1ab-6f86af012d36 req-226b4fa5-0b78-498f-85c3-65b29782dff1 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received unexpected event network-vif-plugged-20104704-4c49-4860-95d3-64fe55afc3b3 for instance with vm_state building and task_state spawning.
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:31:57 user nova-compute[70869]:   <uuid>c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36</uuid>
Jul 25 15:31:57 user nova-compute[70869]:   <name>instance-00000006</name>
Jul 25 15:31:57 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:31:57 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:31:57 user nova-compute[70869]:   <metadata>
Jul 25 15:31:57 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:31:57 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:name>tempest-ServerActionsV293TestJSON-server-679150226</nova:name>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:31:57</nova:creationTime>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:31:57 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:31:57 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:owner>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:user uuid="d0d6af7f176145f382a7cc839ed2c027">tempest-ServerActionsV293TestJSON-1601506810-project-member</nova:user>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:project uuid="27d4e6ad84894e2d8ca5aee1aa77db4e">tempest-ServerActionsV293TestJSON-1601506810</nova:project>
Jul 25 15:31:57 user nova-compute[70869]:       </nova:owner>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:31:57 user nova-compute[70869]:       <nova:ports>
Jul 25 15:31:57 user nova-compute[70869]:         <nova:port uuid="2606ef46-4806-4296-b081-1e354878db1f">
Jul 25 15:31:57 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 15:31:57 user nova-compute[70869]:         </nova:port>
Jul 25 15:31:57 user nova-compute[70869]:       </nova:ports>
Jul 25 15:31:57 user nova-compute[70869]:     </nova:instance>
Jul 25 15:31:57 user nova-compute[70869]:   </metadata>
Jul 25 15:31:57 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:31:57 user nova-compute[70869]:     <system>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="serial">c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="uuid">c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36</entry>
Jul 25 15:31:57 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:31:57 user nova-compute[70869]:     </system>
Jul 25 15:31:57 user nova-compute[70869]:   </sysinfo>
Jul 25 15:31:57 user nova-compute[70869]:   <os>
Jul 25 15:31:57 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:31:57 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:31:57 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:31:57 user nova-compute[70869]:   </os>
Jul 25 15:31:57 user nova-compute[70869]:   <features>
Jul 25 15:31:57 user nova-compute[70869]:     <acpi/>
Jul 25 15:31:57 user nova-compute[70869]:     <apic/>
Jul 25 15:31:57 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:31:57 user nova-compute[70869]:   </features>
Jul 25 15:31:57 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:31:57 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:31:57 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:31:57 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:31:57 user nova-compute[70869]:   </clock>
Jul 25 15:31:57 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:31:57 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:31:57 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:31:57 user nova-compute[70869]:   </cpu>
Jul 25 15:31:57 user nova-compute[70869]:   <devices>
Jul 25 15:31:57 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:31:57 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:31:57 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk"/>
Jul 25 15:31:57 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:31:57 user nova-compute[70869]:     </disk>
Jul 25 15:31:57 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:31:57 user nova-compute[70869]:       <mac address="fa:16:3e:2d:63:8e"/>
Jul 25 15:31:57 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:57 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:31:57 user nova-compute[70869]:       <target dev="tap2606ef46-48"/>
Jul 25 15:31:57 user nova-compute[70869]:     </interface>
Jul 25 15:31:57 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:31:57 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/console.log" append="off"/>
Jul 25 15:31:57 user nova-compute[70869]:     </serial>
Jul 25 15:31:57 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:31:57 user nova-compute[70869]:     <video>
Jul 25 15:31:57 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:57 user nova-compute[70869]:     </video>
Jul 25 15:31:57 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:31:57 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:31:57 user nova-compute[70869]:     </rng>
Jul 25 15:31:57 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:31:57 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:31:57 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:31:57 user nova-compute[70869]:     </memballoon>
Jul 25 15:31:57 user nova-compute[70869]:   </devices>
Jul 25 15:31:57 user nova-compute[70869]: </domain>
Jul 25 15:31:57 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-679150226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-679150226',id=6,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd5ruZaws+3RLrARdKgK3cmlipmHN2NhoKSEL2XI1JlqdOPd5N5x9NV4Ofw/kMNgySHUP1LDOJI7s2MoBufg2/4aflCz0SM6ZcsFLhQtZmMGazc86LsU1BaJroeb181pA==',key_name='tempest-keypair-252354925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27d4e6ad84894e2d8ca5aee1aa77db4e',ramdisk_id='',reservation_id='r-hujuwjkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1601506810',owner_user_name='tempest-ServerActionsV293TestJSON-1601506810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0d6af7f176145f382a7cc839ed2c027',uuid=c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converting VIF {"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:8e,bridge_name='br-int',has_traffic_filtering=True,id=2606ef46-4806-4296-b081-1e354878db1f,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2606ef46-48') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG os_vif [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:8e,bridge_name='br-int',has_traffic_filtering=True,id=2606ef46-4806-4296-b081-1e354878db1f,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2606ef46-48') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:31:57 user nova-compute[70869]: INFO os_vif [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=b512c720-cc12-4cbd-98b1-62b64bc2a752,network=Network(947170b3-5f57-43a6-a8a1-c3d4ae38a0e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb512c720-cc')
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2606ef46-48, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2606ef46-48, col_values=(('external_ids', {'iface-id': '2606ef46-4806-4296-b081-1e354878db1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:63:8e', 'vm-uuid': 'c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:57 user nova-compute[70869]: INFO os_vif [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:63:8e,bridge_name='br-int',has_traffic_filtering=True,id=2606ef46-4806-4296-b081-1e354878db1f,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2606ef46-48')
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] No VIF found with MAC fa:16:3e:30:bc:ad, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] No VIF found with MAC fa:16:3e:2d:63:8e, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Successfully updated port: b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquired lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:57 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-3a3ab24f-c364-474e-83a4-5217157fa588 req-a0136e3d-4c06-435e-96b2-aab77e197d9c service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-changed-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-3a3ab24f-c364-474e-83a4-5217157fa588 req-a0136e3d-4c06-435e-96b2-aab77e197d9c service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Refreshing instance network info cache due to event network-changed-b7d31348-a01c-40f7-993c-e350d788f767. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3a3ab24f-c364-474e-83a4-5217157fa588 req-a0136e3d-4c06-435e-96b2-aab77e197d9c service nova] Acquiring lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-e5a828de-e834-456c-ae92-6056ad88ecda req-6c49ae04-756e-498f-9c7a-ed35233bceae service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Updated VIF entry in instance network info cache for port b512c720-cc12-4cbd-98b1-62b64bc2a752. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-e5a828de-e834-456c-ae92-6056ad88ecda req-6c49ae04-756e-498f-9c7a-ed35233bceae service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating instance_info_cache with network_info: [{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e5a828de-e834-456c-ae92-6056ad88ecda req-6c49ae04-756e-498f-9c7a-ed35233bceae service nova] Releasing lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received event network-changed-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Refreshing instance network info cache due to event network-changed-2606ef46-4806-4296-b081-1e354878db1f. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] Acquiring lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] Acquired lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Refreshing network info cache for port 2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299118.742936, bb1bf680-5ab7-4210-b3d1-44fe0775a9ca => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:31:58 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] VM Resumed (Lifecycle Event)
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:31:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Instance spawned successfully.
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:31:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Instance spawned successfully.
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:31:58 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299118.7455208, bb1bf680-5ab7-4210-b3d1-44fe0775a9ca => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:31:58 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] VM Started (Lifecycle Event)
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:58 user nova-compute[70869]: INFO nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Took 15.89 seconds to spawn the instance on the hypervisor.
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:31:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Instance spawned successfully.
Jul 25 15:31:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299118.8425064, 8beb6a74-a413-4a75-b8ce-678447cff1a5 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] VM Resumed (Lifecycle Event)
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Took 16.28 seconds to spawn the instance on the hypervisor.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Took 17.08 seconds to build instance.
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299118.8491507, 8beb6a74-a413-4a75-b8ce-678447cff1a5 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] VM Started (Lifecycle Event)
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b7825492-3863-4655-bdbf-6a8c04d7ca46 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.327s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Took 15.19 seconds to spawn the instance on the hypervisor.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299118.8929727, 5ce85315-be2f-4be3-953f-ed7b5d4685d6 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] VM Resumed (Lifecycle Event)
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299118.8967278, 5ce85315-be2f-4be3-953f-ed7b5d4685d6 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] VM Started (Lifecycle Event)
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Took 17.29 seconds to build instance.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1809031d-b6a5-432c-8592-71263a5e2fb3 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.523s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:31:59 user nova-compute[70869]: INFO nova.compute.manager [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Took 16.46 seconds to build instance.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-af7147df-85cf-496e-89b7-837b4123bcfb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.595s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating instance_info_cache with network_info: [{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Releasing lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Instance network_info: |[{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3a3ab24f-c364-474e-83a4-5217157fa588 req-a0136e3d-4c06-435e-96b2-aab77e197d9c service nova] Acquired lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.network.neutron [req-3a3ab24f-c364-474e-83a4-5217157fa588 req-a0136e3d-4c06-435e-96b2-aab77e197d9c service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Refreshing network info cache for port b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Start _get_guest_xml network_info=[{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:31:59 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:59 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905910393',display_name='tempest-ServerActionsTestOtherA-server-1905910393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905910393',id=5,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-on5sl0lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bf86a3b2-1ba1-490d-aef7-cbd7f17693c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'pci_devices' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:31:59 user nova-compute[70869]:   <uuid>bf86a3b2-1ba1-490d-aef7-cbd7f17693c1</uuid>
Jul 25 15:31:59 user nova-compute[70869]:   <name>instance-00000005</name>
Jul 25 15:31:59 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:31:59 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:31:59 user nova-compute[70869]:   <metadata>
Jul 25 15:31:59 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:31:59 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:31:59 user nova-compute[70869]:       <nova:name>tempest-ServerActionsTestOtherA-server-1905910393</nova:name>
Jul 25 15:31:59 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:31:59</nova:creationTime>
Jul 25 15:31:59 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:31:59 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:31:59 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:31:59 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:31:59 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:31:59 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:31:59 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:31:59 user nova-compute[70869]:       <nova:owner>
Jul 25 15:31:59 user nova-compute[70869]:         <nova:user uuid="3d09efb7dac2429a97ec41381705c5a5">tempest-ServerActionsTestOtherA-798279085-project-member</nova:user>
Jul 25 15:31:59 user nova-compute[70869]:         <nova:project uuid="f52ab59c5e0a442aa53ad1edd6b4ec5e">tempest-ServerActionsTestOtherA-798279085</nova:project>
Jul 25 15:31:59 user nova-compute[70869]:       </nova:owner>
Jul 25 15:31:59 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:31:59 user nova-compute[70869]:       <nova:ports>
Jul 25 15:31:59 user nova-compute[70869]:         <nova:port uuid="b7d31348-a01c-40f7-993c-e350d788f767">
Jul 25 15:31:59 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 15:31:59 user nova-compute[70869]:         </nova:port>
Jul 25 15:31:59 user nova-compute[70869]:       </nova:ports>
Jul 25 15:31:59 user nova-compute[70869]:     </nova:instance>
Jul 25 15:31:59 user nova-compute[70869]:   </metadata>
Jul 25 15:31:59 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:31:59 user nova-compute[70869]:     <system>
Jul 25 15:31:59 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:31:59 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:31:59 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:31:59 user nova-compute[70869]:       <entry name="serial">bf86a3b2-1ba1-490d-aef7-cbd7f17693c1</entry>
Jul 25 15:31:59 user nova-compute[70869]:       <entry name="uuid">bf86a3b2-1ba1-490d-aef7-cbd7f17693c1</entry>
Jul 25 15:31:59 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:31:59 user nova-compute[70869]:     </system>
Jul 25 15:31:59 user nova-compute[70869]:   </sysinfo>
Jul 25 15:31:59 user nova-compute[70869]:   <os>
Jul 25 15:31:59 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:31:59 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:31:59 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:31:59 user nova-compute[70869]:   </os>
Jul 25 15:31:59 user nova-compute[70869]:   <features>
Jul 25 15:31:59 user nova-compute[70869]:     <acpi/>
Jul 25 15:31:59 user nova-compute[70869]:     <apic/>
Jul 25 15:31:59 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:31:59 user nova-compute[70869]:   </features>
Jul 25 15:31:59 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:31:59 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:31:59 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:31:59 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:31:59 user nova-compute[70869]:   </clock>
Jul 25 15:31:59 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:31:59 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:31:59 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:31:59 user nova-compute[70869]:   </cpu>
Jul 25 15:31:59 user nova-compute[70869]:   <devices>
Jul 25 15:31:59 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:31:59 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:31:59 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk"/>
Jul 25 15:31:59 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:31:59 user nova-compute[70869]:     </disk>
Jul 25 15:31:59 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:31:59 user nova-compute[70869]:       <mac address="fa:16:3e:51:e8:f2"/>
Jul 25 15:31:59 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:59 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:31:59 user nova-compute[70869]:       <target dev="tapb7d31348-a0"/>
Jul 25 15:31:59 user nova-compute[70869]:     </interface>
Jul 25 15:31:59 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:31:59 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/console.log" append="off"/>
Jul 25 15:31:59 user nova-compute[70869]:     </serial>
Jul 25 15:31:59 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:31:59 user nova-compute[70869]:     <video>
Jul 25 15:31:59 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:31:59 user nova-compute[70869]:     </video>
Jul 25 15:31:59 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:31:59 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:31:59 user nova-compute[70869]:     </rng>
Jul 25 15:31:59 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:31:59 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:31:59 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:31:59 user nova-compute[70869]:     </memballoon>
Jul 25 15:31:59 user nova-compute[70869]:   </devices>
Jul 25 15:31:59 user nova-compute[70869]: </domain>
Jul 25 15:31:59 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905910393',display_name='tempest-ServerActionsTestOtherA-server-1905910393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905910393',id=5,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-on5sl0lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:31:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bf86a3b2-1ba1-490d-aef7-cbd7f17693c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG os_vif [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7d31348-a0, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7d31348-a0, col_values=(('external_ids', {'iface-id': 'b7d31348-a01c-40f7-993c-e350d788f767', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:e8:f2', 'vm-uuid': 'bf86a3b2-1ba1-490d-aef7-cbd7f17693c1'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:31:59 user nova-compute[70869]: INFO os_vif [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0')
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.network.neutron [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Updated VIF entry in instance network info cache for port 2606ef46-4806-4296-b081-1e354878db1f. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.network.neutron [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Updating instance_info_cache with network_info: [{"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] Releasing lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received event network-vif-plugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] Acquiring lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] No waiting events found dispatching network-vif-plugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:31:59 user nova-compute[70869]: WARNING nova.compute.manager [req-2a04fc37-686b-439e-8fb6-170f0330d35c req-fb386061-6128-4100-af38-89c64f941b83 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received unexpected event network-vif-plugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf for instance with vm_state building and task_state spawning.
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No VIF found with MAC fa:16:3e:51:e8:f2, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-e2ac8ad2-197b-49b8-9ed4-70ef150dfd15 req-2e8f788d-d797-48d9-b962-f4d1f51540ea service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received event network-vif-plugged-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e2ac8ad2-197b-49b8-9ed4-70ef150dfd15 req-2e8f788d-d797-48d9-b962-f4d1f51540ea service nova] Acquiring lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e2ac8ad2-197b-49b8-9ed4-70ef150dfd15 req-2e8f788d-d797-48d9-b962-f4d1f51540ea service nova] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e2ac8ad2-197b-49b8-9ed4-70ef150dfd15 req-2e8f788d-d797-48d9-b962-f4d1f51540ea service nova] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:31:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-e2ac8ad2-197b-49b8-9ed4-70ef150dfd15 req-2e8f788d-d797-48d9-b962-f4d1f51540ea service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] No waiting events found dispatching network-vif-plugged-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:31:59 user nova-compute[70869]: WARNING nova.compute.manager [req-e2ac8ad2-197b-49b8-9ed4-70ef150dfd15 req-2e8f788d-d797-48d9-b962-f4d1f51540ea service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received unexpected event network-vif-plugged-20104704-4c49-4860-95d3-64fe55afc3b3 for instance with vm_state active and task_state None.
Jul 25 15:32:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-0bb20087-d53d-41a3-b6e8-64022ec453f2 req-0dc50a27-4822-4d6c-bc9a-c4ad0e0a1545 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received event network-vif-plugged-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0bb20087-d53d-41a3-b6e8-64022ec453f2 req-0dc50a27-4822-4d6c-bc9a-c4ad0e0a1545 service nova] Acquiring lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0bb20087-d53d-41a3-b6e8-64022ec453f2 req-0dc50a27-4822-4d6c-bc9a-c4ad0e0a1545 service nova] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0bb20087-d53d-41a3-b6e8-64022ec453f2 req-0dc50a27-4822-4d6c-bc9a-c4ad0e0a1545 service nova] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-0bb20087-d53d-41a3-b6e8-64022ec453f2 req-0dc50a27-4822-4d6c-bc9a-c4ad0e0a1545 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] No waiting events found dispatching network-vif-plugged-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:00 user nova-compute[70869]: WARNING nova.compute.manager [req-0bb20087-d53d-41a3-b6e8-64022ec453f2 req-0dc50a27-4822-4d6c-bc9a-c4ad0e0a1545 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received unexpected event network-vif-plugged-2606ef46-4806-4296-b081-1e354878db1f for instance with vm_state building and task_state spawning.
Jul 25 15:32:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG nova.network.neutron [req-3a3ab24f-c364-474e-83a4-5217157fa588 req-a0136e3d-4c06-435e-96b2-aab77e197d9c service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updated VIF entry in instance network info cache for port b7d31348-a01c-40f7-993c-e350d788f767. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG nova.network.neutron [req-3a3ab24f-c364-474e-83a4-5217157fa588 req-a0136e3d-4c06-435e-96b2-aab77e197d9c service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating instance_info_cache with network_info: [{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3a3ab24f-c364-474e-83a4-5217157fa588 req-a0136e3d-4c06-435e-96b2-aab77e197d9c service nova] Releasing lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-7e97142b-79e3-4ad9-8258-4f47f6e34902 req-c9d99977-d445-4ffa-867c-e780d3c979db service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received event network-vif-plugged-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7e97142b-79e3-4ad9-8258-4f47f6e34902 req-c9d99977-d445-4ffa-867c-e780d3c979db service nova] Acquiring lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7e97142b-79e3-4ad9-8258-4f47f6e34902 req-c9d99977-d445-4ffa-867c-e780d3c979db service nova] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7e97142b-79e3-4ad9-8258-4f47f6e34902 req-c9d99977-d445-4ffa-867c-e780d3c979db service nova] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-7e97142b-79e3-4ad9-8258-4f47f6e34902 req-c9d99977-d445-4ffa-867c-e780d3c979db service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] No waiting events found dispatching network-vif-plugged-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:01 user nova-compute[70869]: WARNING nova.compute.manager [req-7e97142b-79e3-4ad9-8258-4f47f6e34902 req-c9d99977-d445-4ffa-867c-e780d3c979db service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received unexpected event network-vif-plugged-8a556969-3c2f-410a-ac20-29e261e06c2a for instance with vm_state active and task_state None.
Jul 25 15:32:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-973a7d62-f75d-4cbd-9f84-6590f8ffb66f req-608b05c0-a972-4190-b03a-f2d9b8eb617e service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received event network-vif-plugged-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-973a7d62-f75d-4cbd-9f84-6590f8ffb66f req-608b05c0-a972-4190-b03a-f2d9b8eb617e service nova] Acquiring lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-973a7d62-f75d-4cbd-9f84-6590f8ffb66f req-608b05c0-a972-4190-b03a-f2d9b8eb617e service nova] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-973a7d62-f75d-4cbd-9f84-6590f8ffb66f req-608b05c0-a972-4190-b03a-f2d9b8eb617e service nova] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-973a7d62-f75d-4cbd-9f84-6590f8ffb66f req-608b05c0-a972-4190-b03a-f2d9b8eb617e service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] No waiting events found dispatching network-vif-plugged-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:02 user nova-compute[70869]: WARNING nova.compute.manager [req-973a7d62-f75d-4cbd-9f84-6590f8ffb66f req-608b05c0-a972-4190-b03a-f2d9b8eb617e service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received unexpected event network-vif-plugged-2606ef46-4806-4296-b081-1e354878db1f for instance with vm_state building and task_state spawning.
Jul 25 15:32:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:04 user nova-compute[70869]: DEBUG nova.compute.manager [req-c7668378-5bb3-48ed-92db-6ce2d0841743 req-3c2056a0-678b-4cf0-8465-69b005a46f06 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received event network-vif-plugged-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c7668378-5bb3-48ed-92db-6ce2d0841743 req-3c2056a0-678b-4cf0-8465-69b005a46f06 service nova] Acquiring lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c7668378-5bb3-48ed-92db-6ce2d0841743 req-3c2056a0-678b-4cf0-8465-69b005a46f06 service nova] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c7668378-5bb3-48ed-92db-6ce2d0841743 req-3c2056a0-678b-4cf0-8465-69b005a46f06 service nova] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:04 user nova-compute[70869]: DEBUG nova.compute.manager [req-c7668378-5bb3-48ed-92db-6ce2d0841743 req-3c2056a0-678b-4cf0-8465-69b005a46f06 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] No waiting events found dispatching network-vif-plugged-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:04 user nova-compute[70869]: WARNING nova.compute.manager [req-c7668378-5bb3-48ed-92db-6ce2d0841743 req-3c2056a0-678b-4cf0-8465-69b005a46f06 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received unexpected event network-vif-plugged-8a556969-3c2f-410a-ac20-29e261e06c2a for instance with vm_state active and task_state None.
Jul 25 15:32:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-2b42f1bc-6f1a-4bb5-b2bb-da06e1ec4a68 req-8b6030a0-4fb7-4b40-b66f-ae20ccdb8606 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b42f1bc-6f1a-4bb5-b2bb-da06e1ec4a68 req-8b6030a0-4fb7-4b40-b66f-ae20ccdb8606 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b42f1bc-6f1a-4bb5-b2bb-da06e1ec4a68 req-8b6030a0-4fb7-4b40-b66f-ae20ccdb8606 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b42f1bc-6f1a-4bb5-b2bb-da06e1ec4a68 req-8b6030a0-4fb7-4b40-b66f-ae20ccdb8606 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-2b42f1bc-6f1a-4bb5-b2bb-da06e1ec4a68 req-8b6030a0-4fb7-4b40-b66f-ae20ccdb8606 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:05 user nova-compute[70869]: WARNING nova.compute.manager [req-2b42f1bc-6f1a-4bb5-b2bb-da06e1ec4a68 req-8b6030a0-4fb7-4b40-b66f-ae20ccdb8606 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state building and task_state spawning.
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299125.683996, c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:05 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] VM Resumed (Lifecycle Event)
Jul 25 15:32:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:05 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Instance spawned successfully.
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:05 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299125.7010894, c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:05 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] VM Started (Lifecycle Event)
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:05 user nova-compute[70869]: INFO nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Took 14.00 seconds to spawn the instance on the hypervisor.
Jul 25 15:32:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:05 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Took 15.38 seconds to build instance.
Jul 25 15:32:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-544d21a8-cb0e-421c-85ea-324bd3e3d256 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.550s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299126.2003996, fa170559-5228-448f-acea-c5b816a22631 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] VM Resumed (Lifecycle Event)
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Instance spawned successfully.
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fa170559-5228-448f-acea-c5b816a22631] Instance spawned successfully.
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299126.2158997, fa170559-5228-448f-acea-c5b816a22631 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] VM Started (Lifecycle Event)
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299126.2162278, bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] VM Resumed (Lifecycle Event)
Jul 25 15:32:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Took 16.62 seconds to spawn the instance on the hypervisor.
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Took 15.28 seconds to spawn the instance on the hypervisor.
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299126.2168043, bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] VM Started (Lifecycle Event)
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Took 17.36 seconds to build instance.
Jul 25 15:32:06 user nova-compute[70869]: INFO nova.compute.manager [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Took 16.27 seconds to build instance.
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f02e9ed2-aa2e-49cf-850c-8375f484d8df tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.389s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2e86da93-2fc1-4e33-98a9-3a619babe95e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.505s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:07 user nova-compute[70869]: WARNING nova.compute.manager [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state active and task_state None.
Jul 25 15:32:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] No waiting events found dispatching network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:07 user nova-compute[70869]: WARNING nova.compute.manager [req-2a8ce89c-2df9-4a69-a134-889949defef6 req-955756b3-2e9b-432f-b05c-2be55c571008 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received unexpected event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 for instance with vm_state active and task_state None.
Jul 25 15:32:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-e72d092f-743e-4278-a682-7761ce2a6e79 req-e2c4d2af-940a-41af-9972-ff84c3b7c66a service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e72d092f-743e-4278-a682-7761ce2a6e79 req-e2c4d2af-940a-41af-9972-ff84c3b7c66a service nova] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e72d092f-743e-4278-a682-7761ce2a6e79 req-e2c4d2af-940a-41af-9972-ff84c3b7c66a service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e72d092f-743e-4278-a682-7761ce2a6e79 req-e2c4d2af-940a-41af-9972-ff84c3b7c66a service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-e72d092f-743e-4278-a682-7761ce2a6e79 req-e2c4d2af-940a-41af-9972-ff84c3b7c66a service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] No waiting events found dispatching network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:09 user nova-compute[70869]: WARNING nova.compute.manager [req-e72d092f-743e-4278-a682-7761ce2a6e79 req-e2c4d2af-940a-41af-9972-ff84c3b7c66a service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received unexpected event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 for instance with vm_state active and task_state None.
Jul 25 15:32:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:32:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:32:11 user nova-compute[70869]: INFO nova.compute.claims [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Claim successful on node user
Jul 25 15:32:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:12 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:32:12 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:32:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.936s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:32:13 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:32:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG nova.policy [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56ffae89ce9840258e11b4866a315821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df48376ed604fc09522486062251014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:32:13 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Creating image(s)
Jul 25 15:32:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "/opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "/opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "/opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.407s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Successfully created port: 90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.400s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk 1073741824" returned: 0 in 0.161s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.586s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.229s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Cannot resize image /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lazy-loading 'migration_context' on Instance uuid 08fa2836-717a-4893-8969-fcab677935a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Ensure instance console log exists: /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:15 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Successfully updated port: 90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:32:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "refresh_cache-08fa2836-717a-4893-8969-fcab677935a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:32:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquired lock "refresh_cache-08fa2836-717a-4893-8969-fcab677935a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:32:15 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:32:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-a8d66b21-6ec3-4cdf-acb6-37fd41d90b07 req-d4196036-0232-428d-b36a-c8eb12c1a337 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-changed-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-a8d66b21-6ec3-4cdf-acb6-37fd41d90b07 req-d4196036-0232-428d-b36a-c8eb12c1a337 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Refreshing instance network info cache due to event network-changed-90ce04e4-d390-4067-8a50-755e4964ab52. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:32:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a8d66b21-6ec3-4cdf-acb6-37fd41d90b07 req-d4196036-0232-428d-b36a-c8eb12c1a337 service nova] Acquiring lock "refresh_cache-08fa2836-717a-4893-8969-fcab677935a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:32:15 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Updating instance_info_cache with network_info: [{"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Releasing lock "refresh_cache-08fa2836-717a-4893-8969-fcab677935a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Instance network_info: |[{"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a8d66b21-6ec3-4cdf-acb6-37fd41d90b07 req-d4196036-0232-428d-b36a-c8eb12c1a337 service nova] Acquired lock "refresh_cache-08fa2836-717a-4893-8969-fcab677935a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.network.neutron [req-a8d66b21-6ec3-4cdf-acb6-37fd41d90b07 req-d4196036-0232-428d-b36a-c8eb12c1a337 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Refreshing network info cache for port 90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Start _get_guest_xml network_info=[{"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:32:16 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:16 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-117956932',display_name='tempest-VolumesAdminNegativeTest-server-117956932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-117956932',id=7,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaV/Pp6vgqKlD297dOFgOpV0KPmbbH6sIp9vsVy2e46eOyA+kXM1piotTyeM9QWtWUyjVTuP/xC+41/MlQWDcXy6TeFJT14MZao2as99pIGBc4Jmbtnnz4rv5VHJBVusw==',key_name='tempest-keypair-928566050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9df48376ed604fc09522486062251014',ramdisk_id='',reservation_id='r-ww4u8wn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-45810269',owner_user_name='tempest-VolumesAdminNegativeTest-45810269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56ffae89ce9840258e11b4866a315821',uuid=08fa2836-717a-4893-8969-fcab677935a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converting VIF {"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:5a:5f,bridge_name='br-int',has_traffic_filtering=True,id=90ce04e4-d390-4067-8a50-755e4964ab52,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ce04e4-d3') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lazy-loading 'pci_devices' on Instance uuid 08fa2836-717a-4893-8969-fcab677935a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:32:16 user nova-compute[70869]:   <uuid>08fa2836-717a-4893-8969-fcab677935a5</uuid>
Jul 25 15:32:16 user nova-compute[70869]:   <name>instance-00000007</name>
Jul 25 15:32:16 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:32:16 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:32:16 user nova-compute[70869]:   <metadata>
Jul 25 15:32:16 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:32:16 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:32:16 user nova-compute[70869]:       <nova:name>tempest-VolumesAdminNegativeTest-server-117956932</nova:name>
Jul 25 15:32:16 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:32:16</nova:creationTime>
Jul 25 15:32:16 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:32:16 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:32:16 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:32:16 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:32:16 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:32:16 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:32:16 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:32:16 user nova-compute[70869]:       <nova:owner>
Jul 25 15:32:16 user nova-compute[70869]:         <nova:user uuid="56ffae89ce9840258e11b4866a315821">tempest-VolumesAdminNegativeTest-45810269-project-member</nova:user>
Jul 25 15:32:16 user nova-compute[70869]:         <nova:project uuid="9df48376ed604fc09522486062251014">tempest-VolumesAdminNegativeTest-45810269</nova:project>
Jul 25 15:32:16 user nova-compute[70869]:       </nova:owner>
Jul 25 15:32:16 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:32:16 user nova-compute[70869]:       <nova:ports>
Jul 25 15:32:16 user nova-compute[70869]:         <nova:port uuid="90ce04e4-d390-4067-8a50-755e4964ab52">
Jul 25 15:32:16 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 15:32:16 user nova-compute[70869]:         </nova:port>
Jul 25 15:32:16 user nova-compute[70869]:       </nova:ports>
Jul 25 15:32:16 user nova-compute[70869]:     </nova:instance>
Jul 25 15:32:16 user nova-compute[70869]:   </metadata>
Jul 25 15:32:16 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:32:16 user nova-compute[70869]:     <system>
Jul 25 15:32:16 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:32:16 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:32:16 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:32:16 user nova-compute[70869]:       <entry name="serial">08fa2836-717a-4893-8969-fcab677935a5</entry>
Jul 25 15:32:16 user nova-compute[70869]:       <entry name="uuid">08fa2836-717a-4893-8969-fcab677935a5</entry>
Jul 25 15:32:16 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:32:16 user nova-compute[70869]:     </system>
Jul 25 15:32:16 user nova-compute[70869]:   </sysinfo>
Jul 25 15:32:16 user nova-compute[70869]:   <os>
Jul 25 15:32:16 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:32:16 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:32:16 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:32:16 user nova-compute[70869]:   </os>
Jul 25 15:32:16 user nova-compute[70869]:   <features>
Jul 25 15:32:16 user nova-compute[70869]:     <acpi/>
Jul 25 15:32:16 user nova-compute[70869]:     <apic/>
Jul 25 15:32:16 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:32:16 user nova-compute[70869]:   </features>
Jul 25 15:32:16 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:32:16 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:32:16 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:32:16 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:32:16 user nova-compute[70869]:   </clock>
Jul 25 15:32:16 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:32:16 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:32:16 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:32:16 user nova-compute[70869]:   </cpu>
Jul 25 15:32:16 user nova-compute[70869]:   <devices>
Jul 25 15:32:16 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:32:16 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:32:16 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk"/>
Jul 25 15:32:16 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:32:16 user nova-compute[70869]:     </disk>
Jul 25 15:32:16 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:32:16 user nova-compute[70869]:       <mac address="fa:16:3e:98:5a:5f"/>
Jul 25 15:32:16 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:32:16 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:32:16 user nova-compute[70869]:       <target dev="tap90ce04e4-d3"/>
Jul 25 15:32:16 user nova-compute[70869]:     </interface>
Jul 25 15:32:16 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:32:16 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/console.log" append="off"/>
Jul 25 15:32:16 user nova-compute[70869]:     </serial>
Jul 25 15:32:16 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:32:16 user nova-compute[70869]:     <video>
Jul 25 15:32:16 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:32:16 user nova-compute[70869]:     </video>
Jul 25 15:32:16 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:32:16 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:32:16 user nova-compute[70869]:     </rng>
Jul 25 15:32:16 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:32:16 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:32:16 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:32:16 user nova-compute[70869]:     </memballoon>
Jul 25 15:32:16 user nova-compute[70869]:   </devices>
Jul 25 15:32:16 user nova-compute[70869]: </domain>
Jul 25 15:32:16 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-117956932',display_name='tempest-VolumesAdminNegativeTest-server-117956932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-117956932',id=7,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaV/Pp6vgqKlD297dOFgOpV0KPmbbH6sIp9vsVy2e46eOyA+kXM1piotTyeM9QWtWUyjVTuP/xC+41/MlQWDcXy6TeFJT14MZao2as99pIGBc4Jmbtnnz4rv5VHJBVusw==',key_name='tempest-keypair-928566050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9df48376ed604fc09522486062251014',ramdisk_id='',reservation_id='r-ww4u8wn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-45810269',owner_user_name='tempest-VolumesAdminNegativeTest-45810269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56ffae89ce9840258e11b4866a315821',uuid=08fa2836-717a-4893-8969-fcab677935a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converting VIF {"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:5a:5f,bridge_name='br-int',has_traffic_filtering=True,id=90ce04e4-d390-4067-8a50-755e4964ab52,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ce04e4-d3') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG os_vif [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:5a:5f,bridge_name='br-int',has_traffic_filtering=True,id=90ce04e4-d390-4067-8a50-755e4964ab52,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ce04e4-d3') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90ce04e4-d3, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90ce04e4-d3, col_values=(('external_ids', {'iface-id': '90ce04e4-d390-4067-8a50-755e4964ab52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:5a:5f', 'vm-uuid': '08fa2836-717a-4893-8969-fcab677935a5'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:16 user nova-compute[70869]: INFO os_vif [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:5a:5f,bridge_name='br-int',has_traffic_filtering=True,id=90ce04e4-d390-4067-8a50-755e4964ab52,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ce04e4-d3')
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:32:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] No VIF found with MAC fa:16:3e:98:5a:5f, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG nova.network.neutron [req-a8d66b21-6ec3-4cdf-acb6-37fd41d90b07 req-d4196036-0232-428d-b36a-c8eb12c1a337 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Updated VIF entry in instance network info cache for port 90ce04e4-d390-4067-8a50-755e4964ab52. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG nova.network.neutron [req-a8d66b21-6ec3-4cdf-acb6-37fd41d90b07 req-d4196036-0232-428d-b36a-c8eb12c1a337 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Updating instance_info_cache with network_info: [{"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a8d66b21-6ec3-4cdf-acb6-37fd41d90b07 req-d4196036-0232-428d-b36a-c8eb12c1a337 service nova] Releasing lock "refresh_cache-08fa2836-717a-4893-8969-fcab677935a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:32:17 user nova-compute[70869]: INFO nova.compute.claims [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Claim successful on node user
Jul 25 15:32:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:32:17 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:32:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:32:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG nova.policy [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c7ff5accf4c429a8949143500dc3122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f5b012a5d9425c84d6a7edde907b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:32:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Creating image(s)
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "/opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "/opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.189s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-25839e1f-3d94-4c28-aa15-95ff1f49ab3e req-51adb6eb-c562-4b6d-9d79-8b5f7678e53b service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-25839e1f-3d94-4c28-aa15-95ff1f49ab3e req-51adb6eb-c562-4b6d-9d79-8b5f7678e53b service nova] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-25839e1f-3d94-4c28-aa15-95ff1f49ab3e req-51adb6eb-c562-4b6d-9d79-8b5f7678e53b service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-25839e1f-3d94-4c28-aa15-95ff1f49ab3e req-51adb6eb-c562-4b6d-9d79-8b5f7678e53b service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-25839e1f-3d94-4c28-aa15-95ff1f49ab3e req-51adb6eb-c562-4b6d-9d79-8b5f7678e53b service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] No waiting events found dispatching network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:18 user nova-compute[70869]: WARNING nova.compute.manager [req-25839e1f-3d94-4c28-aa15-95ff1f49ab3e req-51adb6eb-c562-4b6d-9d79-8b5f7678e53b service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received unexpected event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 for instance with vm_state building and task_state spawning.
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.220s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk 1073741824" returned: 0 in 0.061s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.182s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Cannot resize image /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lazy-loading 'migration_context' on Instance uuid 3a84f092-352e-4039-8dcb-bd4578458765 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Ensure instance console log exists: /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Successfully created port: 52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:32:19 user nova-compute[70869]: INFO nova.compute.claims [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Claim successful on node user
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:32:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.347s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:32:20 user nova-compute[70869]: INFO nova.compute.claims [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Claim successful on node user
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:32:20 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.policy [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f21c066cfdbd498a9ac779e762799d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5e728d1bdf4015b917d1d77e7a2e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:32:20 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Creating image(s)
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Successfully updated port: 52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "refresh_cache-3a84f092-352e-4039-8dcb-bd4578458765" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquired lock "refresh_cache-3a84f092-352e-4039-8dcb-bd4578458765" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299140.666603, 08fa2836-717a-4893-8969-fcab677935a5 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:20 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 08fa2836-717a-4893-8969-fcab677935a5] VM Resumed (Lifecycle Event)
Jul 25 15:32:20 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Instance spawned successfully.
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] No waiting events found dispatching network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:20 user nova-compute[70869]: WARNING nova.compute.manager [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received unexpected event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 for instance with vm_state building and task_state spawning.
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received event network-changed-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Refreshing instance network info cache due to event network-changed-52bceafd-7e96-4a5e-b6b8-b834538e8f19. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] Acquiring lock "refresh_cache-3a84f092-352e-4039-8dcb-bd4578458765" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.165s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.013s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:20 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 08fa2836-717a-4893-8969-fcab677935a5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299140.6669786, 08fa2836-717a-4893-8969-fcab677935a5 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:20 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 08fa2836-717a-4893-8969-fcab677935a5] VM Started (Lifecycle Event)
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.174s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:20 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 08fa2836-717a-4893-8969-fcab677935a5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:32:21 user nova-compute[70869]: INFO nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Took 7.65 seconds to spawn the instance on the hypervisor.
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk 1073741824" returned: 0 in 0.080s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:32:21 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:32:21 user nova-compute[70869]: INFO nova.compute.manager [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Took 9.30 seconds to build instance.
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.183s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6da98a53-7031-4b0f-bddf-18a11e2df1ad tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.547s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Updating instance_info_cache with network_info: [{"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.policy [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e1e8710f4904363a23e996fc5ef8e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05df151eb8f9406b8714421b1e7af0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Cannot resize image /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.objects.instance [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lazy-loading 'migration_context' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Ensure instance console log exists: /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Releasing lock "refresh_cache-3a84f092-352e-4039-8dcb-bd4578458765" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Instance network_info: |[{"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] Acquired lock "refresh_cache-3a84f092-352e-4039-8dcb-bd4578458765" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Refreshing network info cache for port 52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Start _get_guest_xml network_info=[{"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:32:21 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Creating image(s)
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "/opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "/opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "/opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "5778590daafe7dbd64801671125503b1b8007c40" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "5778590daafe7dbd64801671125503b1b8007c40" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Successfully created port: 9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:32:21 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:21 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1642226982',display_name='tempest-TestVolumeSwap-server-1642226982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1642226982',id=8,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnOkx3HAoPtkWdlC8+9FqzZTopJtEeUeBvP1UWbhw0o7OJBh0EKd0GxdYIyVn5Jj1u/EKSNuN9/Qaoxx2hfCGkCa8zSieRQnSIT2Smsp7wXQVyYwfQ2mgP70e6jvzQQ0A==',key_name='tempest-keypair-1985031647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f5b012a5d9425c84d6a7edde907b89',ramdisk_id='',reservation_id='r-8oybzjer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-813504377',owner_user_name='tempest-TestVolumeSwap-813504377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:32:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7ff5accf4c429a8949143500dc3122',uuid=3a84f092-352e-4039-8dcb-bd4578458765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Converting VIF {"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:87,bridge_name='br-int',has_traffic_filtering=True,id=52bceafd-7e96-4a5e-b6b8-b834538e8f19,network=Network(bc2b010c-bbfe-4478-8a11-1be65adf9b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bceafd-7e') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a84f092-352e-4039-8dcb-bd4578458765 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:32:22 user nova-compute[70869]:   <uuid>3a84f092-352e-4039-8dcb-bd4578458765</uuid>
Jul 25 15:32:22 user nova-compute[70869]:   <name>instance-00000008</name>
Jul 25 15:32:22 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:32:22 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:32:22 user nova-compute[70869]:   <metadata>
Jul 25 15:32:22 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:32:22 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:32:22 user nova-compute[70869]:       <nova:name>tempest-TestVolumeSwap-server-1642226982</nova:name>
Jul 25 15:32:22 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:32:21</nova:creationTime>
Jul 25 15:32:22 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:32:22 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:32:22 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:32:22 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:32:22 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:32:22 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:32:22 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:32:22 user nova-compute[70869]:       <nova:owner>
Jul 25 15:32:22 user nova-compute[70869]:         <nova:user uuid="3c7ff5accf4c429a8949143500dc3122">tempest-TestVolumeSwap-813504377-project-member</nova:user>
Jul 25 15:32:22 user nova-compute[70869]:         <nova:project uuid="86f5b012a5d9425c84d6a7edde907b89">tempest-TestVolumeSwap-813504377</nova:project>
Jul 25 15:32:22 user nova-compute[70869]:       </nova:owner>
Jul 25 15:32:22 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:32:22 user nova-compute[70869]:       <nova:ports>
Jul 25 15:32:22 user nova-compute[70869]:         <nova:port uuid="52bceafd-7e96-4a5e-b6b8-b834538e8f19">
Jul 25 15:32:22 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 15:32:22 user nova-compute[70869]:         </nova:port>
Jul 25 15:32:22 user nova-compute[70869]:       </nova:ports>
Jul 25 15:32:22 user nova-compute[70869]:     </nova:instance>
Jul 25 15:32:22 user nova-compute[70869]:   </metadata>
Jul 25 15:32:22 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:32:22 user nova-compute[70869]:     <system>
Jul 25 15:32:22 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:32:22 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:32:22 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:32:22 user nova-compute[70869]:       <entry name="serial">3a84f092-352e-4039-8dcb-bd4578458765</entry>
Jul 25 15:32:22 user nova-compute[70869]:       <entry name="uuid">3a84f092-352e-4039-8dcb-bd4578458765</entry>
Jul 25 15:32:22 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:32:22 user nova-compute[70869]:     </system>
Jul 25 15:32:22 user nova-compute[70869]:   </sysinfo>
Jul 25 15:32:22 user nova-compute[70869]:   <os>
Jul 25 15:32:22 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:32:22 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:32:22 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:32:22 user nova-compute[70869]:   </os>
Jul 25 15:32:22 user nova-compute[70869]:   <features>
Jul 25 15:32:22 user nova-compute[70869]:     <acpi/>
Jul 25 15:32:22 user nova-compute[70869]:     <apic/>
Jul 25 15:32:22 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:32:22 user nova-compute[70869]:   </features>
Jul 25 15:32:22 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:32:22 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:32:22 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:32:22 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:32:22 user nova-compute[70869]:   </clock>
Jul 25 15:32:22 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:32:22 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:32:22 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:32:22 user nova-compute[70869]:   </cpu>
Jul 25 15:32:22 user nova-compute[70869]:   <devices>
Jul 25 15:32:22 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:32:22 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:32:22 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk"/>
Jul 25 15:32:22 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:32:22 user nova-compute[70869]:     </disk>
Jul 25 15:32:22 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:32:22 user nova-compute[70869]:       <mac address="fa:16:3e:8b:58:87"/>
Jul 25 15:32:22 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:32:22 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:32:22 user nova-compute[70869]:       <target dev="tap52bceafd-7e"/>
Jul 25 15:32:22 user nova-compute[70869]:     </interface>
Jul 25 15:32:22 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:32:22 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/console.log" append="off"/>
Jul 25 15:32:22 user nova-compute[70869]:     </serial>
Jul 25 15:32:22 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:32:22 user nova-compute[70869]:     <video>
Jul 25 15:32:22 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:32:22 user nova-compute[70869]:     </video>
Jul 25 15:32:22 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:32:22 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:32:22 user nova-compute[70869]:     </rng>
Jul 25 15:32:22 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:32:22 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:32:22 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:32:22 user nova-compute[70869]:     </memballoon>
Jul 25 15:32:22 user nova-compute[70869]:   </devices>
Jul 25 15:32:22 user nova-compute[70869]: </domain>
Jul 25 15:32:22 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1642226982',display_name='tempest-TestVolumeSwap-server-1642226982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1642226982',id=8,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnOkx3HAoPtkWdlC8+9FqzZTopJtEeUeBvP1UWbhw0o7OJBh0EKd0GxdYIyVn5Jj1u/EKSNuN9/Qaoxx2hfCGkCa8zSieRQnSIT2Smsp7wXQVyYwfQ2mgP70e6jvzQQ0A==',key_name='tempest-keypair-1985031647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f5b012a5d9425c84d6a7edde907b89',ramdisk_id='',reservation_id='r-8oybzjer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-813504377',owner_user_name='tempest-TestVolumeSwap-813504377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:32:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7ff5accf4c429a8949143500dc3122',uuid=3a84f092-352e-4039-8dcb-bd4578458765,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Converting VIF {"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:87,bridge_name='br-int',has_traffic_filtering=True,id=52bceafd-7e96-4a5e-b6b8-b834538e8f19,network=Network(bc2b010c-bbfe-4478-8a11-1be65adf9b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bceafd-7e') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG os_vif [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:87,bridge_name='br-int',has_traffic_filtering=True,id=52bceafd-7e96-4a5e-b6b8-b834538e8f19,network=Network(bc2b010c-bbfe-4478-8a11-1be65adf9b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bceafd-7e') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52bceafd-7e, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52bceafd-7e, col_values=(('external_ids', {'iface-id': '52bceafd-7e96-4a5e-b6b8-b834538e8f19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:58:87', 'vm-uuid': '3a84f092-352e-4039-8dcb-bd4578458765'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:22 user nova-compute[70869]: INFO os_vif [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:87,bridge_name='br-int',has_traffic_filtering=True,id=52bceafd-7e96-4a5e-b6b8-b834538e8f19,network=Network(bc2b010c-bbfe-4478-8a11-1be65adf9b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bceafd-7e')
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40.part --force-share --output=json" returned: 0 in 0.224s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.virt.images [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] aa0f69e0-2bfb-4d53-8589-81e36f386fd0 was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40.part /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] No VIF found with MAC fa:16:3e:8b:58:87, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Successfully created port: 99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40.part /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40.converted" returned: 0 in 0.199s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Successfully updated port: 9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquired lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c7cdaa5-ea2e-432c-a7d4-7f6b28f3086b req-aeec970a-1a6a-46e7-8a12-d018306768c5 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-changed-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c7cdaa5-ea2e-432c-a7d4-7f6b28f3086b req-aeec970a-1a6a-46e7-8a12-d018306768c5 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Refreshing instance network info cache due to event network-changed-9911ada1-3a21-4e33-be13-d786a18560fd. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c7cdaa5-ea2e-432c-a7d4-7f6b28f3086b req-aeec970a-1a6a-46e7-8a12-d018306768c5 service nova] Acquiring lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.network.neutron [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Updated VIF entry in instance network info cache for port 52bceafd-7e96-4a5e-b6b8-b834538e8f19. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.network.neutron [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Updating instance_info_cache with network_info: [{"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b867d720-a19c-4dcd-9539-27c627b302c9 req-22ac22a2-9443-4c9c-beba-6aca36f64e3a service nova] Releasing lock "refresh_cache-3a84f092-352e-4039-8dcb-bd4578458765" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "5778590daafe7dbd64801671125503b1b8007c40" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.092s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40 --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "5778590daafe7dbd64801671125503b1b8007c40" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "5778590daafe7dbd64801671125503b1b8007c40" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Skipping network cache update for instance because it is Building. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Skipping network cache update for instance because it is Building. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Skipping network cache update for instance because it is Building. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40 --force-share --output=json" returned: 0 in 0.172s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40,backing_fmt=raw /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40,backing_fmt=raw /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk 1073741824" returned: 0 in 0.061s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "5778590daafe7dbd64801671125503b1b8007c40" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid bb1bf680-5ab7-4210-b3d1-44fe0775a9ca {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.neutron [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updating instance_info_cache with network_info: [{"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Releasing lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Instance network_info: |[{"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c7cdaa5-ea2e-432c-a7d4-7f6b28f3086b req-aeec970a-1a6a-46e7-8a12-d018306768c5 service nova] Acquired lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-9c7cdaa5-ea2e-432c-a7d4-7f6b28f3086b req-aeec970a-1a6a-46e7-8a12-d018306768c5 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Refreshing network info cache for port 9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Start _get_guest_xml network_info=[{"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40 --force-share --output=json" returned: 0 in 0.162s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Successfully updated port: 99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-d8de5519-b64b-41a5-a0cf-ad0730216cfd req-43d5933f-18df-462f-a8db-6c1f802f94ab service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received event network-changed-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-d8de5519-b64b-41a5-a0cf-ad0730216cfd req-43d5933f-18df-462f-a8db-6c1f802f94ab service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Refreshing instance network info cache due to event network-changed-99306340-f2ac-483c-99d4-bf4a0fd05c25. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d8de5519-b64b-41a5-a0cf-ad0730216cfd req-43d5933f-18df-462f-a8db-6c1f802f94ab service nova] Acquiring lock "refresh_cache-3927367a-ad7c-4ad7-9812-4b0199e9a9a1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d8de5519-b64b-41a5-a0cf-ad0730216cfd req-43d5933f-18df-462f-a8db-6c1f802f94ab service nova] Acquired lock "refresh_cache-3927367a-ad7c-4ad7-9812-4b0199e9a9a1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-d8de5519-b64b-41a5-a0cf-ad0730216cfd req-43d5933f-18df-462f-a8db-6c1f802f94ab service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Refreshing network info cache for port 99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "refresh_cache-3927367a-ad7c-4ad7-9812-4b0199e9a9a1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:32:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881880919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881880919',id=9,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCnjUFS4GVvp1uY+i4MWSiPTipwFlk1fAmhL09GyrCSrjDVSQvYyS8MW2Ahfcl4CTdExtioOorFgZMog5w/XI0cedHfxpHuJtENl/M1IXTFU2CPc7Y1H/+dLskGA8s5g==',key_name='tempest-keypair-1573765752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e5e728d1bdf4015b917d1d77e7a2e75',ramdisk_id='',reservation_id='r-enxwzktb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1524187401',owner_user_name='tempest-TaggedAttachmentsTest-1524187401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21c066cfdbd498a9ac779e762799d2b',uuid=b6c9b6d1-5006-4160-a559-ea5c46e7c4ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converting VIF {"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c8:d3,bridge_name='br-int',has_traffic_filtering=True,id=9911ada1-3a21-4e33-be13-d786a18560fd,network=Network(31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9911ada1-3a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.objects.instance [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lazy-loading 'pci_devices' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Cannot resize image /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.objects.instance [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lazy-loading 'migration_context' on Instance uuid 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Ensure instance console log exists: /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:32:23 user nova-compute[70869]:   <uuid>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</uuid>
Jul 25 15:32:23 user nova-compute[70869]:   <name>instance-00000009</name>
Jul 25 15:32:23 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:32:23 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:32:23 user nova-compute[70869]:   <metadata>
Jul 25 15:32:23 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:32:23 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:32:23 user nova-compute[70869]:       <nova:name>tempest-device-tagging-server-1881880919</nova:name>
Jul 25 15:32:23 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:32:23</nova:creationTime>
Jul 25 15:32:23 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:32:23 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:32:23 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:32:23 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:32:23 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:32:23 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:32:23 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:32:23 user nova-compute[70869]:       <nova:owner>
Jul 25 15:32:23 user nova-compute[70869]:         <nova:user uuid="f21c066cfdbd498a9ac779e762799d2b">tempest-TaggedAttachmentsTest-1524187401-project-member</nova:user>
Jul 25 15:32:23 user nova-compute[70869]:         <nova:project uuid="5e5e728d1bdf4015b917d1d77e7a2e75">tempest-TaggedAttachmentsTest-1524187401</nova:project>
Jul 25 15:32:23 user nova-compute[70869]:       </nova:owner>
Jul 25 15:32:23 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:32:23 user nova-compute[70869]:       <nova:ports>
Jul 25 15:32:23 user nova-compute[70869]:         <nova:port uuid="9911ada1-3a21-4e33-be13-d786a18560fd">
Jul 25 15:32:23 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:32:23 user nova-compute[70869]:         </nova:port>
Jul 25 15:32:23 user nova-compute[70869]:       </nova:ports>
Jul 25 15:32:23 user nova-compute[70869]:     </nova:instance>
Jul 25 15:32:23 user nova-compute[70869]:   </metadata>
Jul 25 15:32:23 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:32:23 user nova-compute[70869]:     <system>
Jul 25 15:32:23 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:32:23 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:32:23 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:32:23 user nova-compute[70869]:       <entry name="serial">b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:32:23 user nova-compute[70869]:       <entry name="uuid">b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:32:23 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:32:23 user nova-compute[70869]:     </system>
Jul 25 15:32:23 user nova-compute[70869]:   </sysinfo>
Jul 25 15:32:23 user nova-compute[70869]:   <os>
Jul 25 15:32:23 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:32:23 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:32:23 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:32:23 user nova-compute[70869]:   </os>
Jul 25 15:32:23 user nova-compute[70869]:   <features>
Jul 25 15:32:23 user nova-compute[70869]:     <acpi/>
Jul 25 15:32:23 user nova-compute[70869]:     <apic/>
Jul 25 15:32:23 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:32:23 user nova-compute[70869]:   </features>
Jul 25 15:32:23 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:32:23 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:32:23 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:32:23 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:32:23 user nova-compute[70869]:   </clock>
Jul 25 15:32:23 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:32:23 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:32:23 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:32:23 user nova-compute[70869]:   </cpu>
Jul 25 15:32:23 user nova-compute[70869]:   <devices>
Jul 25 15:32:23 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:32:23 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:32:23 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk"/>
Jul 25 15:32:23 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:32:23 user nova-compute[70869]:     </disk>
Jul 25 15:32:23 user nova-compute[70869]:     <disk type="file" device="cdrom">
Jul 25 15:32:23 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 15:32:23 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.config"/>
Jul 25 15:32:23 user nova-compute[70869]:       <target dev="hda" bus="ide"/>
Jul 25 15:32:23 user nova-compute[70869]:     </disk>
Jul 25 15:32:23 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:32:23 user nova-compute[70869]:       <mac address="fa:16:3e:cc:c8:d3"/>
Jul 25 15:32:23 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:32:23 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:32:23 user nova-compute[70869]:       <target dev="tap9911ada1-3a"/>
Jul 25 15:32:23 user nova-compute[70869]:     </interface>
Jul 25 15:32:23 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:32:23 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log" append="off"/>
Jul 25 15:32:23 user nova-compute[70869]:     </serial>
Jul 25 15:32:23 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:32:23 user nova-compute[70869]:     <video>
Jul 25 15:32:23 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:32:23 user nova-compute[70869]:     </video>
Jul 25 15:32:23 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:32:23 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:32:23 user nova-compute[70869]:     </rng>
Jul 25 15:32:23 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:32:23 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:32:23 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:32:23 user nova-compute[70869]:     </memballoon>
Jul 25 15:32:23 user nova-compute[70869]:   </devices>
Jul 25 15:32:23 user nova-compute[70869]: </domain>
Jul 25 15:32:23 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881880919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881880919',id=9,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCnjUFS4GVvp1uY+i4MWSiPTipwFlk1fAmhL09GyrCSrjDVSQvYyS8MW2Ahfcl4CTdExtioOorFgZMog5w/XI0cedHfxpHuJtENl/M1IXTFU2CPc7Y1H/+dLskGA8s5g==',key_name='tempest-keypair-1573765752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e5e728d1bdf4015b917d1d77e7a2e75',ramdisk_id='',reservation_id='r-enxwzktb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1524187401',owner_user_name='tempest-TaggedAttachmentsTest-1524187401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21c066cfdbd498a9ac779e762799d2b',uuid=b6c9b6d1-5006-4160-a559-ea5c46e7c4ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converting VIF {"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c8:d3,bridge_name='br-int',has_traffic_filtering=True,id=9911ada1-3a21-4e33-be13-d786a18560fd,network=Network(31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9911ada1-3a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG os_vif [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c8:d3,bridge_name='br-int',has_traffic_filtering=True,id=9911ada1-3a21-4e33-be13-d786a18560fd,network=Network(31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9911ada1-3a') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-d8de5519-b64b-41a5-a0cf-ad0730216cfd req-43d5933f-18df-462f-a8db-6c1f802f94ab service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9911ada1-3a, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9911ada1-3a, col_values=(('external_ids', {'iface-id': '9911ada1-3a21-4e33-be13-d786a18560fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:c8:d3', 'vm-uuid': 'b6c9b6d1-5006-4160-a559-ea5c46e7c4ff'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:23 user nova-compute[70869]: INFO os_vif [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:c8:d3,bridge_name='br-int',has_traffic_filtering=True,id=9911ada1-3a21-4e33-be13-d786a18560fd,network=Network(31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9911ada1-3a')
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] No BDM found with device name hda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] No VIF found with MAC fa:16:3e:cc:c8:d3, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:32:23 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Using config drive
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-d8de5519-b64b-41a5-a0cf-ad0730216cfd req-43d5933f-18df-462f-a8db-6c1f802f94ab service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d8de5519-b64b-41a5-a0cf-ad0730216cfd req-43d5933f-18df-462f-a8db-6c1f802f94ab service nova] Releasing lock "refresh_cache-3927367a-ad7c-4ad7-9812-4b0199e9a9a1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquired lock "refresh_cache-3927367a-ad7c-4ad7-9812-4b0199e9a9a1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:32:23 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.network.neutron [req-9c7cdaa5-ea2e-432c-a7d4-7f6b28f3086b req-aeec970a-1a6a-46e7-8a12-d018306768c5 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updated VIF entry in instance network info cache for port 9911ada1-3a21-4e33-be13-d786a18560fd. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.network.neutron [req-9c7cdaa5-ea2e-432c-a7d4-7f6b28f3086b req-aeec970a-1a6a-46e7-8a12-d018306768c5 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updating instance_info_cache with network_info: [{"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c7cdaa5-ea2e-432c-a7d4-7f6b28f3086b req-aeec970a-1a6a-46e7-8a12-d018306768c5 service nova] Releasing lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Updating instance_info_cache with network_info: [{"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 15:32:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Creating config drive at /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.config
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw4qih_el {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] There are 0 instances to clean {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances with incomplete migration  {{(pid=70869) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-9b8b8d1b-3d58-4874-ab62-6f192d4ceac4 req-7d60a93e-101a-494b-a9e7-94cdd998e42c service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received event network-vif-plugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9b8b8d1b-3d58-4874-ab62-6f192d4ceac4 req-7d60a93e-101a-494b-a9e7-94cdd998e42c service nova] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9b8b8d1b-3d58-4874-ab62-6f192d4ceac4 req-7d60a93e-101a-494b-a9e7-94cdd998e42c service nova] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9b8b8d1b-3d58-4874-ab62-6f192d4ceac4 req-7d60a93e-101a-494b-a9e7-94cdd998e42c service nova] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-9b8b8d1b-3d58-4874-ab62-6f192d4ceac4 req-7d60a93e-101a-494b-a9e7-94cdd998e42c service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] No waiting events found dispatching network-vif-plugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:24 user nova-compute[70869]: WARNING nova.compute.manager [req-9b8b8d1b-3d58-4874-ab62-6f192d4ceac4 req-7d60a93e-101a-494b-a9e7-94cdd998e42c service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received unexpected event network-vif-plugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 for instance with vm_state building and task_state spawning.
Jul 25 15:32:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Updating instance_info_cache with network_info: [{"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw4qih_el" returned: 0 in 0.617s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Releasing lock "refresh_cache-3927367a-ad7c-4ad7-9812-4b0199e9a9a1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Instance network_info: |[{"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:32:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Start _get_guest_xml network_info=[{"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:32:11Z,direct_url=<?>,disk_format='qcow2',id=aa0f69e0-2bfb-4d53-8589-81e36f386fd0,min_disk=0,min_ram=0,name='',owner='34018f5eef37483ca9e5abb549bc16d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'size': 0, 'device_type': 'disk', 'image_id': 'aa0f69e0-2bfb-4d53-8589-81e36f386fd0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:32:25 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:25 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:32:11Z,direct_url=<?>,disk_format='qcow2',id=aa0f69e0-2bfb-4d53-8589-81e36f386fd0,min_disk=0,min_ram=0,name='',owner='34018f5eef37483ca9e5abb549bc16d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1884369105',display_name='tempest-AttachSCSIVolumeTestJSON-server-1884369105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1884369105',id=10,image_ref='aa0f69e0-2bfb-4d53-8589-81e36f386fd0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw8zi87+wGXCP7RLTtFdU6LEEezPfYJtYWXWZF8LivMwb0+9kTun2GBjW6DN9vjSP+D+RHavSaXLYD6OW9PzuSXyYaX7Zm+K+yxahyAxv78zmW/7zj6HAqhogrVh4Ha/Q==',key_name='tempest-keypair-907253329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05df151eb8f9406b8714421b1e7af0e6',ramdisk_id='',reservation_id='r-quwo9g9k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa0f69e0-2bfb-4d53-8589-81e36f386fd0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-221261173',owner_user_name='tempest-AttachSCSIVolumeTestJSON-221261173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e1e8710f4904363a23e996fc5ef8e2c',uuid=3927367a-ad7c-4ad7-9812-4b0199e9a9a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Converting VIF {"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:da:73,bridge_name='br-int',has_traffic_filtering=True,id=99306340-f2ac-483c-99d4-bf4a0fd05c25,network=Network(330b3a38-d9af-4cb2-86c5-3d501a783659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99306340-f2') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.objects.instance [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lazy-loading 'pci_devices' on Instance uuid 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:32:25 user nova-compute[70869]:   <uuid>3927367a-ad7c-4ad7-9812-4b0199e9a9a1</uuid>
Jul 25 15:32:25 user nova-compute[70869]:   <name>instance-0000000a</name>
Jul 25 15:32:25 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:32:25 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:32:25 user nova-compute[70869]:   <metadata>
Jul 25 15:32:25 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:32:25 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:32:25 user nova-compute[70869]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1884369105</nova:name>
Jul 25 15:32:25 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:32:25</nova:creationTime>
Jul 25 15:32:25 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:32:25 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:32:25 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:32:25 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:32:25 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:32:25 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:32:25 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:32:25 user nova-compute[70869]:       <nova:owner>
Jul 25 15:32:25 user nova-compute[70869]:         <nova:user uuid="8e1e8710f4904363a23e996fc5ef8e2c">tempest-AttachSCSIVolumeTestJSON-221261173-project-member</nova:user>
Jul 25 15:32:25 user nova-compute[70869]:         <nova:project uuid="05df151eb8f9406b8714421b1e7af0e6">tempest-AttachSCSIVolumeTestJSON-221261173</nova:project>
Jul 25 15:32:25 user nova-compute[70869]:       </nova:owner>
Jul 25 15:32:25 user nova-compute[70869]:       <nova:root type="image" uuid="aa0f69e0-2bfb-4d53-8589-81e36f386fd0"/>
Jul 25 15:32:25 user nova-compute[70869]:       <nova:ports>
Jul 25 15:32:25 user nova-compute[70869]:         <nova:port uuid="99306340-f2ac-483c-99d4-bf4a0fd05c25">
Jul 25 15:32:25 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 15:32:25 user nova-compute[70869]:         </nova:port>
Jul 25 15:32:25 user nova-compute[70869]:       </nova:ports>
Jul 25 15:32:25 user nova-compute[70869]:     </nova:instance>
Jul 25 15:32:25 user nova-compute[70869]:   </metadata>
Jul 25 15:32:25 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:32:25 user nova-compute[70869]:     <system>
Jul 25 15:32:25 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:32:25 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:32:25 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:32:25 user nova-compute[70869]:       <entry name="serial">3927367a-ad7c-4ad7-9812-4b0199e9a9a1</entry>
Jul 25 15:32:25 user nova-compute[70869]:       <entry name="uuid">3927367a-ad7c-4ad7-9812-4b0199e9a9a1</entry>
Jul 25 15:32:25 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:32:25 user nova-compute[70869]:     </system>
Jul 25 15:32:25 user nova-compute[70869]:   </sysinfo>
Jul 25 15:32:25 user nova-compute[70869]:   <os>
Jul 25 15:32:25 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:32:25 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:32:25 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:32:25 user nova-compute[70869]:   </os>
Jul 25 15:32:25 user nova-compute[70869]:   <features>
Jul 25 15:32:25 user nova-compute[70869]:     <acpi/>
Jul 25 15:32:25 user nova-compute[70869]:     <apic/>
Jul 25 15:32:25 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:32:25 user nova-compute[70869]:   </features>
Jul 25 15:32:25 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:32:25 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:32:25 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:32:25 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:32:25 user nova-compute[70869]:   </clock>
Jul 25 15:32:25 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:32:25 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:32:25 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:32:25 user nova-compute[70869]:   </cpu>
Jul 25 15:32:25 user nova-compute[70869]:   <devices>
Jul 25 15:32:25 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:32:25 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:32:25 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk"/>
Jul 25 15:32:25 user nova-compute[70869]:       <target dev="sda" bus="scsi"/>
Jul 25 15:32:25 user nova-compute[70869]:       <address type="drive" controller="0" unit="0"/>
Jul 25 15:32:25 user nova-compute[70869]:     </disk>
Jul 25 15:32:25 user nova-compute[70869]:     <disk type="file" device="cdrom">
Jul 25 15:32:25 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 15:32:25 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk.config"/>
Jul 25 15:32:25 user nova-compute[70869]:       <target dev="sdb" bus="scsi"/>
Jul 25 15:32:25 user nova-compute[70869]:       <address type="drive" controller="0" unit="1"/>
Jul 25 15:32:25 user nova-compute[70869]:     </disk>
Jul 25 15:32:25 user nova-compute[70869]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 25 15:32:25 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:32:25 user nova-compute[70869]:       <mac address="fa:16:3e:73:da:73"/>
Jul 25 15:32:25 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:32:25 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:32:25 user nova-compute[70869]:       <target dev="tap99306340-f2"/>
Jul 25 15:32:25 user nova-compute[70869]:     </interface>
Jul 25 15:32:25 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:32:25 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/console.log" append="off"/>
Jul 25 15:32:25 user nova-compute[70869]:     </serial>
Jul 25 15:32:25 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:32:25 user nova-compute[70869]:     <video>
Jul 25 15:32:25 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:32:25 user nova-compute[70869]:     </video>
Jul 25 15:32:25 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:32:25 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:32:25 user nova-compute[70869]:     </rng>
Jul 25 15:32:25 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:32:25 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:32:25 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:32:25 user nova-compute[70869]:     </memballoon>
Jul 25 15:32:25 user nova-compute[70869]:   </devices>
Jul 25 15:32:25 user nova-compute[70869]: </domain>
Jul 25 15:32:25 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1884369105',display_name='tempest-AttachSCSIVolumeTestJSON-server-1884369105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1884369105',id=10,image_ref='aa0f69e0-2bfb-4d53-8589-81e36f386fd0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw8zi87+wGXCP7RLTtFdU6LEEezPfYJtYWXWZF8LivMwb0+9kTun2GBjW6DN9vjSP+D+RHavSaXLYD6OW9PzuSXyYaX7Zm+K+yxahyAxv78zmW/7zj6HAqhogrVh4Ha/Q==',key_name='tempest-keypair-907253329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05df151eb8f9406b8714421b1e7af0e6',ramdisk_id='',reservation_id='r-quwo9g9k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa0f69e0-2bfb-4d53-8589-81e36f386fd0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-221261173',owner_user_name='tempest-AttachSCSIVolumeTestJSON-221261173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e1e8710f4904363a23e996fc5ef8e2c',uuid=3927367a-ad7c-4ad7-9812-4b0199e9a9a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Converting VIF {"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:da:73,bridge_name='br-int',has_traffic_filtering=True,id=99306340-f2ac-483c-99d4-bf4a0fd05c25,network=Network(330b3a38-d9af-4cb2-86c5-3d501a783659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99306340-f2') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG os_vif [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:da:73,bridge_name='br-int',has_traffic_filtering=True,id=99306340-f2ac-483c-99d4-bf4a0fd05c25,network=Network(330b3a38-d9af-4cb2-86c5-3d501a783659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99306340-f2') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99306340-f2, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99306340-f2, col_values=(('external_ids', {'iface-id': '99306340-f2ac-483c-99d4-bf4a0fd05c25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:da:73', 'vm-uuid': '3927367a-ad7c-4ad7-9812-4b0199e9a9a1'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:25 user nova-compute[70869]: INFO os_vif [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:da:73,bridge_name='br-int',has_traffic_filtering=True,id=99306340-f2ac-483c-99d4-bf4a0fd05c25,network=Network(330b3a38-d9af-4cb2-86c5-3d501a783659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99306340-f2')
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] No BDM found with device name sda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] No VIF found with MAC fa:16:3e:73:da:73, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:32:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Using config drive
Jul 25 15:32:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Creating config drive at /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk.config
Jul 25 15:32:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppvwto3bd {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppvwto3bd" returned: 0 in 0.053s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-cac10fd9-b6bf-4c98-99b4-ce843162aaff req-d3af387b-7035-4054-b315-6cbc3c76bb83 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received event network-vif-plugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cac10fd9-b6bf-4c98-99b4-ce843162aaff req-d3af387b-7035-4054-b315-6cbc3c76bb83 service nova] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cac10fd9-b6bf-4c98-99b4-ce843162aaff req-d3af387b-7035-4054-b315-6cbc3c76bb83 service nova] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cac10fd9-b6bf-4c98-99b4-ce843162aaff req-d3af387b-7035-4054-b315-6cbc3c76bb83 service nova] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-cac10fd9-b6bf-4c98-99b4-ce843162aaff req-d3af387b-7035-4054-b315-6cbc3c76bb83 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] No waiting events found dispatching network-vif-plugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:26 user nova-compute[70869]: WARNING nova.compute.manager [req-cac10fd9-b6bf-4c98-99b4-ce843162aaff req-d3af387b-7035-4054-b315-6cbc3c76bb83 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received unexpected event network-vif-plugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 for instance with vm_state building and task_state spawning.
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299146.5779898, 3a84f092-352e-4039-8dcb-bd4578458765 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:26 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] VM Resumed (Lifecycle Event)
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:32:26 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Instance spawned successfully.
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:26 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299146.583536, 3a84f092-352e-4039-8dcb-bd4578458765 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:26 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] VM Started (Lifecycle Event)
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:26 user nova-compute[70869]: INFO nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Took 8.43 seconds to spawn the instance on the hypervisor.
Jul 25 15:32:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:26 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:26 user nova-compute[70869]: INFO nova.compute.manager [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Took 9.48 seconds to build instance.
Jul 25 15:32:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b148dfc1-1cde-4f95-8f1f-cf294ece19aa tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.619s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:32:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-04492fc0-575d-4e11-979f-9d97b0b78ff6 req-72c15e91-1395-4878-a386-45ed9f1f47e1 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-plugged-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-04492fc0-575d-4e11-979f-9d97b0b78ff6 req-72c15e91-1395-4878-a386-45ed9f1f47e1 service nova] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-04492fc0-575d-4e11-979f-9d97b0b78ff6 req-72c15e91-1395-4878-a386-45ed9f1f47e1 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-04492fc0-575d-4e11-979f-9d97b0b78ff6 req-72c15e91-1395-4878-a386-45ed9f1f47e1 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-04492fc0-575d-4e11-979f-9d97b0b78ff6 req-72c15e91-1395-4878-a386-45ed9f1f47e1 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] No waiting events found dispatching network-vif-plugged-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:28 user nova-compute[70869]: WARNING nova.compute.manager [req-04492fc0-575d-4e11-979f-9d97b0b78ff6 req-72c15e91-1395-4878-a386-45ed9f1f47e1 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received unexpected event network-vif-plugged-9911ada1-3a21-4e33-be13-d786a18560fd for instance with vm_state building and task_state spawning.
Jul 25 15:32:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-56bb3a6e-7325-4921-ba51-50aac3084b91 req-b6223830-453a-4b9f-8fd9-aa581f9344c4 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received event network-vif-plugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-56bb3a6e-7325-4921-ba51-50aac3084b91 req-b6223830-453a-4b9f-8fd9-aa581f9344c4 service nova] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-56bb3a6e-7325-4921-ba51-50aac3084b91 req-b6223830-453a-4b9f-8fd9-aa581f9344c4 service nova] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-56bb3a6e-7325-4921-ba51-50aac3084b91 req-b6223830-453a-4b9f-8fd9-aa581f9344c4 service nova] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-56bb3a6e-7325-4921-ba51-50aac3084b91 req-b6223830-453a-4b9f-8fd9-aa581f9344c4 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] No waiting events found dispatching network-vif-plugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:28 user nova-compute[70869]: WARNING nova.compute.manager [req-56bb3a6e-7325-4921-ba51-50aac3084b91 req-b6223830-453a-4b9f-8fd9-aa581f9344c4 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received unexpected event network-vif-plugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 for instance with vm_state building and task_state spawning.
Jul 25 15:32:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-dad920f7-405b-401a-a8a8-0047ee3dd679 req-3f7656c8-0528-4643-b090-dfd418e7d392 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-plugged-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dad920f7-405b-401a-a8a8-0047ee3dd679 req-3f7656c8-0528-4643-b090-dfd418e7d392 service nova] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dad920f7-405b-401a-a8a8-0047ee3dd679 req-3f7656c8-0528-4643-b090-dfd418e7d392 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dad920f7-405b-401a-a8a8-0047ee3dd679 req-3f7656c8-0528-4643-b090-dfd418e7d392 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-dad920f7-405b-401a-a8a8-0047ee3dd679 req-3f7656c8-0528-4643-b090-dfd418e7d392 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] No waiting events found dispatching network-vif-plugged-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:30 user nova-compute[70869]: WARNING nova.compute.manager [req-dad920f7-405b-401a-a8a8-0047ee3dd679 req-3f7656c8-0528-4643-b090-dfd418e7d392 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received unexpected event network-vif-plugged-9911ada1-3a21-4e33-be13-d786a18560fd for instance with vm_state building and task_state spawning.
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-3d6f16c5-54db-4426-ae49-774fbda787e3 req-3b2d2a24-b3ba-45a5-bf0d-6a4ed41684ce service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received event network-vif-plugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3d6f16c5-54db-4426-ae49-774fbda787e3 req-3b2d2a24-b3ba-45a5-bf0d-6a4ed41684ce service nova] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3d6f16c5-54db-4426-ae49-774fbda787e3 req-3b2d2a24-b3ba-45a5-bf0d-6a4ed41684ce service nova] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3d6f16c5-54db-4426-ae49-774fbda787e3 req-3b2d2a24-b3ba-45a5-bf0d-6a4ed41684ce service nova] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-3d6f16c5-54db-4426-ae49-774fbda787e3 req-3b2d2a24-b3ba-45a5-bf0d-6a4ed41684ce service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] No waiting events found dispatching network-vif-plugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:32:30 user nova-compute[70869]: WARNING nova.compute.manager [req-3d6f16c5-54db-4426-ae49-774fbda787e3 req-3b2d2a24-b3ba-45a5-bf0d-6a4ed41684ce service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received unexpected event network-vif-plugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 for instance with vm_state building and task_state spawning.
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299150.793456, 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:30 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] VM Resumed (Lifecycle Event)
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:32:30 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Instance spawned successfully.
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:32:30 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Instance spawned successfully.
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:32:30 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299150.7950318, b6c9b6d1-5006-4160-a559-ea5c46e7c4ff => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:30 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] VM Resumed (Lifecycle Event)
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:30 user nova-compute[70869]: INFO nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Took 9.53 seconds to spawn the instance on the hypervisor.
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:30 user nova-compute[70869]: INFO nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Took 10.45 seconds to spawn the instance on the hypervisor.
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:31 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299150.7954535, 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] VM Started (Lifecycle Event)
Jul 25 15:32:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:32:31 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299150.7955558, b6c9b6d1-5006-4160-a559-ea5c46e7c4ff => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:32:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] VM Started (Lifecycle Event)
Jul 25 15:32:31 user nova-compute[70869]: INFO nova.compute.manager [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Took 11.47 seconds to build instance.
Jul 25 15:32:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-acd189de-e328-43a9-a3a4-8bb490f13a1a tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.640s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:31 user nova-compute[70869]: INFO nova.compute.manager [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Took 11.30 seconds to build instance.
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bcaf8beb-ad0f-4102-92d3-fe68f7be4f24 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.435s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:32:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:33 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:33 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7474MB free_disk=25.891708374023438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bb1bf680-5ab7-4210-b3d1-44fe0775a9ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fa170559-5228-448f-acea-c5b816a22631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 08fa2836-717a-4893-8969-fcab677935a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3a84f092-352e-4039-8dcb-bd4578458765 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing inventories for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating ProviderTree inventory for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing aggregate associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, aggregates: None {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 15:32:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing trait associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41 {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 15:32:34 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:32:34 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:32:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:32:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.053s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:35 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:35 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:35 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:32:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:32:59 user nova-compute[70869]: INFO nova.compute.claims [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Claim successful on node user
Jul 25 15:32:59 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:32:59 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:32:59 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:32:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:32:59 user nova-compute[70869]: INFO nova.virt.block_device [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Booting with volume 83b11d21-4b1c-4b4c-bcea-8c4d97b5551a at /dev/vda
Jul 25 15:33:00 user nova-compute[70869]: DEBUG nova.policy [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbc9f3d11336441abf6bc378105758d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97ba47b47034968baabdd2f11ba829e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:33:00 user nova-compute[70869]: DEBUG os_brick.utils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:00 user nova-compute[70869]: INFO oslo.privsep.daemon [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmph83waw31/privsep.sock']
Jul 25 15:33:00 user sudo[82045]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmph83waw31/privsep.sock
Jul 25 15:33:00 user sudo[82045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 25 15:33:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully created port: 870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully created port: 897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:33:01 user nova-compute[70869]: INFO nova.compute.claims [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Claim successful on node user
Jul 25 15:33:01 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:33:01 user sudo[82045]: pam_unix(sudo:session): session closed for user root
Jul 25 15:33:01 user nova-compute[70869]: INFO oslo.privsep.daemon [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Spawned new privsep daemon via rootwrap
Jul 25 15:33:01 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 25 15:33:01 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 25 15:33:01 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 25 15:33:01 user nova-compute[70869]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82054
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a24e9a-a997-4c00-869b-f105ab828393]: (2,) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:33:01 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:33:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3d9c25-288e-4690-987b-35325136effb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:01 user nova-compute[70869]: WARNING os_brick.initiator.connectors.nvmeof [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:01 user nova-compute[70869]: INFO nova.virt.block_device [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Booting with volume 17bd7b79-d155-49ef-a6dd-a3b8826067b1 at /dev/vda
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b339439-f9c6-4a74-b45b-103f0a73425d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2b4f4c-2f94-4f57-82b0-6275c0fe0963]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50677aa-a8a5-4b88-b258-c5412d5c42bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.utils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG nova.policy [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0980deba3f4e4b6e8ef276d2502e7bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b435a0b68ec412388fb4d85e0df701e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully created port: 4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[31daa17d-99c5-4a7e-913c-5f17b6843f6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:02 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb0d9eb-3d6d-4dfb-a0ab-799b2d6298d9]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.utils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] <== get_connector_properties: return (1992ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating existing volume attachment record: 897b1c06-4b2c-479a-a379-719cd1fe332a {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3be06a-cc07-4ac7-a578-9611b21e2651]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b613d60a-a74d-4d76-8a9d-cf09161c14f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6961daf-dc65-4369-9ffc-b54e86892358]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:02 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:33:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[368c30c4-d8a3-475d-a78a-280b76907d86]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG os_brick.utils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating existing volume attachment record: fea4177f-1a97-4ca4-976d-3bd294ff94f9 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully created port: 2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:02 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully created port: f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:03 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully created port: aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:03 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully created port: 5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:03 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully updated port: 870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-c5f3b61e-f712-42df-b7da-285495398c38 req-86ad5ca5-18f7-4681-a1f9-ad7549269f90 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-changed-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-c5f3b61e-f712-42df-b7da-285495398c38 req-86ad5ca5-18f7-4681-a1f9-ad7549269f90 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing instance network info cache due to event network-changed-870b555f-c0da-4f5e-bda0-b7fabc60bf16. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c5f3b61e-f712-42df-b7da-285495398c38 req-86ad5ca5-18f7-4681-a1f9-ad7549269f90 service nova] Acquiring lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c5f3b61e-f712-42df-b7da-285495398c38 req-86ad5ca5-18f7-4681-a1f9-ad7549269f90 service nova] Acquired lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:03 user nova-compute[70869]: DEBUG nova.network.neutron [req-c5f3b61e-f712-42df-b7da-285495398c38 req-86ad5ca5-18f7-4681-a1f9-ad7549269f90 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing network info cache for port 870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:04 user nova-compute[70869]: DEBUG nova.network.neutron [req-c5f3b61e-f712-42df-b7da-285495398c38 req-86ad5ca5-18f7-4681-a1f9-ad7549269f90 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:04 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully created port: 84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:04 user nova-compute[70869]: DEBUG nova.network.neutron [req-c5f3b61e-f712-42df-b7da-285495398c38 req-86ad5ca5-18f7-4681-a1f9-ad7549269f90 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c5f3b61e-f712-42df-b7da-285495398c38 req-86ad5ca5-18f7-4681-a1f9-ad7549269f90 service nova] Releasing lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:04 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully updated port: 4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:04 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully created port: 5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:05 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully created port: 56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:05 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully updated port: bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully updated port: f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-changed-4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing instance network info cache due to event network-changed-4bddee83-4e25-4ba3-b3d7-4547eeb347ce. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] Acquiring lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] Acquired lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing network info cache for port 4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-c6deb1be-7429-41b3-bff1-6902268df9fe req-38c8e964-b257-4108-ad7c-c551b7028e9f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-changed-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-c6deb1be-7429-41b3-bff1-6902268df9fe req-38c8e964-b257-4108-ad7c-c551b7028e9f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing instance network info cache due to event network-changed-f826bc9f-7358-4bac-9f9a-7fd060b7d350. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c6deb1be-7429-41b3-bff1-6902268df9fe req-38c8e964-b257-4108-ad7c-c551b7028e9f service nova] Acquiring lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c6deb1be-7429-41b3-bff1-6902268df9fe req-38c8e964-b257-4108-ad7c-c551b7028e9f service nova] Acquired lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [req-c6deb1be-7429-41b3-bff1-6902268df9fe req-38c8e964-b257-4108-ad7c-c551b7028e9f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing network info cache for port f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully updated port: 897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [req-c6deb1be-7429-41b3-bff1-6902268df9fe req-38c8e964-b257-4108-ad7c-c551b7028e9f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] Releasing lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-changed-bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing instance network info cache due to event network-changed-bbf6f9d2-6384-426f-a998-fb276fa27036. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] Acquiring lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] Acquired lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing network info cache for port bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-97763b1b-f508-4ac6-a3e4-1e31b0ff2a9b req-655f74e0-1c84-42ed-b86c-c9eabe6fe7eb service nova] Releasing lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG nova.network.neutron [req-c6deb1be-7429-41b3-bff1-6902268df9fe req-38c8e964-b257-4108-ad7c-c551b7028e9f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c6deb1be-7429-41b3-bff1-6902268df9fe req-38c8e964-b257-4108-ad7c-c551b7028e9f service nova] Releasing lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully updated port: 4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully updated port: 20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully updated port: 2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-changed-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing instance network info cache due to event network-changed-897ee821-0b60-41af-86cc-8fb8fcbb63bf. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] Acquiring lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] Acquired lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing network info cache for port 897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-0fc58124-7c6b-41db-a7bc-be3586289c73 req-aad5cc90-551d-4c9a-b77e-ce3558b93354 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-changed-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-0fc58124-7c6b-41db-a7bc-be3586289c73 req-aad5cc90-551d-4c9a-b77e-ce3558b93354 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing instance network info cache due to event network-changed-20bd65f0-1d1d-4c3c-a7eb-4712eef84404. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0fc58124-7c6b-41db-a7bc-be3586289c73 req-aad5cc90-551d-4c9a-b77e-ce3558b93354 service nova] Acquiring lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0fc58124-7c6b-41db-a7bc-be3586289c73 req-aad5cc90-551d-4c9a-b77e-ce3558b93354 service nova] Acquired lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-0fc58124-7c6b-41db-a7bc-be3586289c73 req-aad5cc90-551d-4c9a-b77e-ce3558b93354 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing network info cache for port 20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-0fc58124-7c6b-41db-a7bc-be3586289c73 req-aad5cc90-551d-4c9a-b77e-ce3558b93354 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully updated port: 5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-0fc58124-7c6b-41db-a7bc-be3586289c73 req-aad5cc90-551d-4c9a-b77e-ce3558b93354 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0fc58124-7c6b-41db-a7bc-be3586289c73 req-aad5cc90-551d-4c9a-b77e-ce3558b93354 service nova] Releasing lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] Releasing lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-changed-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing instance network info cache due to event network-changed-4c68f351-19c4-4d47-859c-6de061d29b5e. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] Acquiring lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] Acquired lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing network info cache for port 4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Successfully updated port: aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] Releasing lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-changed-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing instance network info cache due to event network-changed-2ebccfbf-e0ec-48fa-be10-4e23441c974b. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] Acquiring lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] Acquired lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing network info cache for port 2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:09 user nova-compute[70869]: INFO nova.virt.block_device [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Booting with volume 5d211ee9-c939-419e-88ae-dfd771f027b9 at /dev/vdb
Jul 25 15:33:09 user nova-compute[70869]: INFO nova.virt.block_device [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Booting with volume 12ff82e7-afb4-48c7-b82b-8c7d85f18491 at /dev/vdb
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.utils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[763cb866-aeba-458f-912d-3a62d7318393]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.utils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfae69f-228f-4f0c-bf4c-d9571af4e1d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efeeb0e-107f-4aa6-bb34-54c88e35e871]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ed7cd8-4739-4182-b4bc-31cfa3c14abe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[11308d40-ec2c-4e8b-8e78-a14ee15db063]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d199f-3b6e-4c53-bf65-26fa39d35545]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:09 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cbc265-d917-4791-91ca-03b4a19bd770]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.utils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating existing volume attachment record: 914f0484-7781-4645-9af6-d72e6a0d276c {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8db773-c979-49bd-89d5-2afc7833aa4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aab12b-f1b6-4f19-a855-e5b26690a347]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-14a9afd4-5f4c-481e-91c1-058f33c1decc req-4422f4b0-83f3-4f88-8cd1-f00fa96695f1 service nova] Releasing lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:09 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[845fa6c3-944f-474a-99f8-5a59c7298b0d]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquired lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG os_brick.utils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating existing volume attachment record: 63fa3b7a-f3d3-48a8-ae5c-f0e22aaf24b9 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully updated port: 5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-1f28a06f-c73d-46be-997b-84b55b01c294 req-62703e26-65ed-4715-aee4-3a15d3dd963e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-changed-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-1f28a06f-c73d-46be-997b-84b55b01c294 req-62703e26-65ed-4715-aee4-3a15d3dd963e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing instance network info cache due to event network-changed-aba97287-1fad-446f-ac84-dba0e2e8112e. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1f28a06f-c73d-46be-997b-84b55b01c294 req-62703e26-65ed-4715-aee4-3a15d3dd963e service nova] Acquiring lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-changed-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing instance network info cache due to event network-changed-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] Acquiring lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] Acquired lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing network info cache for port 5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] Releasing lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-changed-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing instance network info cache due to event network-changed-5ae3ba86-1b57-403c-ab34-9f65aff4c95e. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] Acquiring lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] Acquired lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing network info cache for port 5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-43b8e3f8-9038-4db4-94a3-b1abd05487c3 req-a6e41aca-6143-416f-8695-c50a2ac6f581 service nova] Releasing lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully updated port: 84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-29d5b520-1afc-4790-86ec-be2f8a11b0e5 req-ec296d83-7848-4d09-93ba-a8f2aed526c9 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-changed-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-29d5b520-1afc-4790-86ec-be2f8a11b0e5 req-ec296d83-7848-4d09-93ba-a8f2aed526c9 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing instance network info cache due to event network-changed-84f5c4a8-261e-4d46-add2-78f955d2d6cc. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-29d5b520-1afc-4790-86ec-be2f8a11b0e5 req-ec296d83-7848-4d09-93ba-a8f2aed526c9 service nova] Acquiring lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-29d5b520-1afc-4790-86ec-be2f8a11b0e5 req-ec296d83-7848-4d09-93ba-a8f2aed526c9 service nova] Acquired lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-29d5b520-1afc-4790-86ec-be2f8a11b0e5 req-ec296d83-7848-4d09-93ba-a8f2aed526c9 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing network info cache for port 84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-29d5b520-1afc-4790-86ec-be2f8a11b0e5 req-ec296d83-7848-4d09-93ba-a8f2aed526c9 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-29d5b520-1afc-4790-86ec-be2f8a11b0e5 req-ec296d83-7848-4d09-93ba-a8f2aed526c9 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-29d5b520-1afc-4790-86ec-be2f8a11b0e5 req-ec296d83-7848-4d09-93ba-a8f2aed526c9 service nova] Releasing lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully updated port: 5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [{"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Releasing lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance network_info: |[{"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:33:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1f28a06f-c73d-46be-997b-84b55b01c294 req-62703e26-65ed-4715-aee4-3a15d3dd963e service nova] Acquired lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-1f28a06f-c73d-46be-997b-84b55b01c294 req-62703e26-65ed-4715-aee4-3a15d3dd963e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing network info cache for port aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.network.neutron [req-1f28a06f-c73d-46be-997b-84b55b01c294 req-62703e26-65ed-4715-aee4-3a15d3dd963e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updated VIF entry in instance network info cache for port aba97287-1fad-446f-ac84-dba0e2e8112e. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.network.neutron [req-1f28a06f-c73d-46be-997b-84b55b01c294 req-62703e26-65ed-4715-aee4-3a15d3dd963e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [{"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-58b51ceb-0134-4a89-b084-b5d91024ff93 req-b308c574-6b1d-4322-9837-3d0502be418c service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-changed-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-58b51ceb-0134-4a89-b084-b5d91024ff93 req-b308c574-6b1d-4322-9837-3d0502be418c service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing instance network info cache due to event network-changed-5e1ad59c-808c-4702-acdc-b95a29dbb164. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-58b51ceb-0134-4a89-b084-b5d91024ff93 req-b308c574-6b1d-4322-9837-3d0502be418c service nova] Acquiring lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-58b51ceb-0134-4a89-b084-b5d91024ff93 req-b308c574-6b1d-4322-9837-3d0502be418c service nova] Acquired lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.network.neutron [req-58b51ceb-0134-4a89-b084-b5d91024ff93 req-b308c574-6b1d-4322-9837-3d0502be418c service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing network info cache for port 5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1f28a06f-c73d-46be-997b-84b55b01c294 req-62703e26-65ed-4715-aee4-3a15d3dd963e service nova] Releasing lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.network.neutron [req-58b51ceb-0134-4a89-b084-b5d91024ff93 req-b308c574-6b1d-4322-9837-3d0502be418c service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Successfully updated port: 56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.network.neutron [req-58b51ceb-0134-4a89-b084-b5d91024ff93 req-b308c574-6b1d-4322-9837-3d0502be418c service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-58b51ceb-0134-4a89-b084-b5d91024ff93 req-b308c574-6b1d-4322-9837-3d0502be418c service nova] Releasing lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquired lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:33:14 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:16 user nova-compute[70869]: INFO nova.virt.block_device [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Booting with volume fed140be-a203-423f-a217-502077c1a262 at /dev/vdc
Jul 25 15:33:16 user nova-compute[70869]: INFO nova.virt.block_device [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Booting with volume 88223f23-8512-4177-baa6-9a1dbec47f73 at /dev/vdc
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.utils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[914cc407-ba1c-4369-b499-e4223b3f080f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.utils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dedb8c-8b40-4552-8834-fd0ceb95135a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e05e7-de78-4c9e-92eb-16fe8e48d229]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d02cb5-d2f4-4d82-a5a8-52de903f2033]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b0cc3a-68dc-4561-8fb0-1a35ba93690a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[341f738b-7e9d-4b74-9fe0-c5c6d3bed476]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:16 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4846b817-e1cf-406c-bfb9-bbbbd8bcc533]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.utils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating existing volume attachment record: 879db0e0-d0ac-407a-bfcf-d5d447e1e854 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[86295737-a563-41f1-a413-a645945043f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d20f76-23c6-4f6b-9465-9500c6114eb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:16 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da1b7b9-8205-4683-8a65-02912d85ba6e]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG os_brick.utils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating existing volume attachment record: 362acb47-3164-4320-8741-e3ab3f9b2405 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-823b4018-9da0-49e1-b447-b148a0c5c078 req-31283243-558c-4988-9523-71b8235f1392 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-changed-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-823b4018-9da0-49e1-b447-b148a0c5c078 req-31283243-558c-4988-9523-71b8235f1392 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing instance network info cache due to event network-changed-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-823b4018-9da0-49e1-b447-b148a0c5c078 req-31283243-558c-4988-9523-71b8235f1392 service nova] Acquiring lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG nova.network.neutron [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [{"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Releasing lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance network_info: |[{"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-823b4018-9da0-49e1-b447-b148a0c5c078 req-31283243-558c-4988-9523-71b8235f1392 service nova] Acquired lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:16 user nova-compute[70869]: DEBUG nova.network.neutron [req-823b4018-9da0-49e1-b447-b148a0c5c078 req-31283243-558c-4988-9523-71b8235f1392 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing network info cache for port 56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:17 user nova-compute[70869]: DEBUG nova.network.neutron [req-823b4018-9da0-49e1-b447-b148a0c5c078 req-31283243-558c-4988-9523-71b8235f1392 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updated VIF entry in instance network info cache for port 56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:33:17 user nova-compute[70869]: DEBUG nova.network.neutron [req-823b4018-9da0-49e1-b447-b148a0c5c078 req-31283243-558c-4988-9523-71b8235f1392 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [{"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-823b4018-9da0-49e1-b447-b148a0c5c078 req-31283243-558c-4988-9523-71b8235f1392 service nova] Releasing lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:33:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:33:23 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Creating image(s)
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Ensure instance console log exists: /opt/stack/data/nova/instances/dd06411a-f6dc-4e4a-894f-517410bda71d/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Start _get_guest_xml network_info=[{"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '897b1c06-4b2c-479a-a379-719cd1fe332a', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVHzYraN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd06411a-f6dc-4e4a-894f-517410bda71d', 'attached_at': '', 'detached_at': '', 'volume_id': '83b11d21-4b1c-4b4c-bcea-8c4d97b5551a', 'serial': '83b11d21-4b1c-4b4c-bcea-8c4d97b5551a'}, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '63fa3b7a-f3d3-48a8-ae5c-f0e22aaf24b9', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZaATFPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd06411a-f6dc-4e4a-894f-517410bda71d', 'attached_at': '', 'detached_at': '', 'volume_id': '12ff82e7-afb4-48c7-b82b-8c7d85f18491', 'serial': '12ff82e7-afb4-48c7-b82b-8c7d85f18491'}, 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '879db0e0-d0ac-407a-bfcf-d5d447e1e854', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoHTJYRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd06411a-f6dc-4e4a-894f-517410bda71d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fed140be-a203-423f-a217-502077c1a262', 'serial': 'fed140be-a203-423f-a217-502077c1a262'}, 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:33:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:33:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connector [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Factory for ISCSI on None {{(pid=70869) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVHzYraN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:23 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:23 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:23 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Updating instance_info_cache with network_info: [{"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:33:23 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Creating image(s)
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Ensure instance console log exists: /opt/stack/data/nova/instances/da94f076-89f8-40be-b8bb-f4f8a73953ae/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Start _get_guest_xml network_info=[{"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fea4177f-1a97-4ca4-976d-3bd294ff94f9', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLUTjqxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da94f076-89f8-40be-b8bb-f4f8a73953ae', 'attached_at': '', 'detached_at': '', 'volume_id': '17bd7b79-d155-49ef-a6dd-a3b8826067b1', 'serial': '17bd7b79-d155-49ef-a6dd-a3b8826067b1'}, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '914f0484-7781-4645-9af6-d72e6a0d276c', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBmWteuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da94f076-89f8-40be-b8bb-f4f8a73953ae', 'attached_at': '', 'detached_at': '', 'volume_id': '5d211ee9-c939-419e-88ae-dfd771f027b9', 'serial': '5d211ee9-c939-419e-88ae-dfd771f027b9'}, 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '362acb47-3164-4320-8741-e3ab3f9b2405', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRNIvZqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da94f076-89f8-40be-b8bb-f4f8a73953ae', 'attached_at': '', 'detached_at': '', 'volume_id': '88223f23-8512-4177-baa6-9a1dbec47f73', 'serial': '88223f23-8512-4177-baa6-9a1dbec47f73'}, 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21b105c-4001-4f92-9c88-c82ec03e27b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:33:23 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:33:23 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLUTjqxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:23 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf2cc55-62e7-4349-9956-d48bb092298e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a] added
Jul 25 15:33:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f48211-1640-4c9f-8505-7cb965b31cd5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb25654-1605-4634-8241-2658e94367a9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QVHzYraN {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QVHzYraN" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcc12e9-c4e8-41cc-b9f6-3975f3b26d56]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QVHzYraN'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[56388f15-df77-4850-8fc6-0755e19cc437]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63640b5-3f75-4335-8a45-029074f1edbc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 15:33:23 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 15:33:23 user nova-compute[70869]:  {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:23 user nova-compute[70869]: WARNING os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 15:33:23 user nova-compute[70869]: 
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f4eff4-bbc8-47a4-b4a2-95ede9d4ac82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a, portal: 172.16.0.220,3260]
Jul 25 15:33:23 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a, portal: 172.16.0.220,3260] successful.
Jul 25 15:33:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad1ca3-f370-4298-8127-d920a42695ce]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f956525-82f1-4e1b-bf1a-191a620812a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[06419e5c-b006-44d7-9a79-2a4ad3fe369f]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:33:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVHzYraN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26639333133343838', 'path': '/dev/sdb'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639333133343838', 'path': '/dev/sdb'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.235s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:24 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:24 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2d5a8d-5863-41f2-9a01-ee7ee5fa396b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:33:24 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZaATFPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:24 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb3042-fc63-4b22-bc0f-698cb41bf079]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1] added
Jul 25 15:33:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48b0a81-06a8-4b4c-8e46-646b613f39d2]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fb0392-577c-4feb-934e-966d49d6bde0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLUTjqxh {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLUTjqxh" returned: 0 in 0.119s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8965c177-576f-44c8-9bd3-2392055b6225]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OLUTjqxh'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c9696-d76c-42f9-9197-85d17aa9d3bd]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[662f3f2f-ff64-4ed4-86d9-b3d1bfe7a19a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:25 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:25 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c5c5a3-0af6-4c91-8575-7c995690b450]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1, portal: 172.16.0.220,3260]
Jul 25 15:33:25 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1, portal: 172.16.0.220,3260] successful.
Jul 25 15:33:25 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e577d8-e5b3-4145-8443-88309ac2b3d3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aa30c1-8bf9-4d51-af3d-837ec8060cf6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:25 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:25 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:25 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:25 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d063274c-8e60-429a-aa08-d49afca6b2fc]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLUTjqxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:33:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] <== connect_volume: return (2621ms) {'type': 'block', 'scsi_wwn': '23936636434306132', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936636434306132', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.352s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:26 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:26 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf729693-3181-4e5f-b84e-540c95b7b5f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:33:26 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBmWteuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:26 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce6c99e-bf13-4140-8a51-f7cdafa2d70b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491] added
Jul 25 15:33:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[080ce4a4-53c4-415a-a514-ec1b3e589c61]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc4d560-62d3-4667-aa94-18ad3a629dc0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KZaATFPu {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KZaATFPu" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2f59eb-a25c-4c45-a55c-277e45dfa436]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KZaATFPu'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c6bba9-d0ff-4113-85d7-662564f3cdb9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2ea04e-ebc2-4f1d-8d5f-afd51471e454]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:26 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:26 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a5e6cc-5cdd-46f8-9912-4b6c2287cc57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491, portal: 172.16.0.220,3260]
Jul 25 15:33:26 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491, portal: 172.16.0.220,3260] successful.
Jul 25 15:33:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6952a1-9e0f-4c91-94f4-37c8077f0860]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff4adc5-ebc1-4aa2-ad56-35351e8f9fdf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:26 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:26 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:26 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:26 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaa8d6e-e8b3-4393-a60a-cf3426e2fd1e]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZaATFPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] <== connect_volume: return (2647ms) {'type': 'block', 'scsi_wwn': '23065343030363366', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065343030363366', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.267s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:27 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:27 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoHTJYRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:27 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccf4fa8-3e0f-413e-9708-35c55fd2e393]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:33:27 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f6faa9-8d4a-41b6-8bdf-5a70812596e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9] added
Jul 25 15:33:27 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[47571f67-a0f1-43bb-9323-3abcd9fbb758]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c8b562-9823-4060-804f-e56201cb7652]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sBmWteuR {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sBmWteuR" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[05966a9c-212f-45aa-ad45-f153a6b57da6]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sBmWteuR'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b7f6c6-7e3a-417a-a155-60a2c1b3a0aa]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b851c75f-5832-407f-b3fb-5dc34099e1b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab5521d-a3f8-44df-91e6-350abd7ae1fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9, portal: 172.16.0.220,3260]
Jul 25 15:33:27 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9, portal: 172.16.0.220,3260] successful.
Jul 25 15:33:27 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4b4c92-857d-403b-afdd-e223a2fda85d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8a6482-b4fc-472c-a1ca-768620ce9263]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:27 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d75c56-f07e-4bea-bdeb-b97c6ad97661]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:27 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBmWteuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] <== connect_volume: return (2626ms) {'type': 'block', 'scsi_wwn': '26561336137656465', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561336137656465', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.325s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:28 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d116f762-7868-412d-adf9-4bad7ce90510]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:33:28 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRNIvZqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d19c12a-ce49-43b3-a74d-201f80c9cb90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262] added
Jul 25 15:33:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a93e2a5-9914-406b-be7e-d77e444c7d53]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbee9481-ce6d-4b97-a0f6-d5543b9e754b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoHTJYRv {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoHTJYRv" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b3c62a-72bf-4722-a634-b726bc4bf43a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LoHTJYRv'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d52b44-1cf2-4d71-bff6-41e31d16c88d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68885f0-3cb5-4a9c-bc57-0f9b2733489f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76ae51-ca14-42a1-b6bb-5d674babd603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262, portal: 172.16.0.220,3260]
Jul 25 15:33:29 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262, portal: 172.16.0.220,3260] successful.
Jul 25 15:33:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26206f8-865c-4bde-bbfb-3725f3219bd8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e93d75e-8c8c-49e4-be4f-4692eeced1e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b87401-94da-4a17-88ac-39cafb32f366]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoHTJYRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] <== connect_volume: return (2719ms) {'type': 'block', 'scsi_wwn': '26131353236666139', 'path': '/dev/sdf'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131353236666139', 'path': '/dev/sdf'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.368s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:30 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:30 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9064d3-77a6-459e-920f-8a4e03ef0b8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:33:30 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:3c,bridge_name='br-int',has_traffic_filtering=True,id=870b555f-c0da-4f5e-bda0-b7fabc60bf16,network=Network(95965bd0-a6d1-4725-ba2b-ef035c839102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870b555f-c0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=4bddee83-4e25-4ba3-b3d7-4547eeb347ce,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bddee83-4e') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:16,bridge_name='br-int',has_traffic_filtering=True,id=bbf6f9d2-6384-426f-a998-fb276fa27036,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf6f9d2-63') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f9:28,bridge_name='br-int',has_traffic_filtering=True,id=897ee821-0b60-41af-86cc-8fb8fcbb63bf,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897ee821-0b') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:9e:c1,bridge_name='br-int',has_traffic_filtering=True,id=4c68f351-19c4-4d47-859c-6de061d29b5e,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c68f351-19') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:be:ab,bridge_name='br-int',has_traffic_filtering=True,id=2ebccfbf-e0ec-48fa-be10-4e23441c974b,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebccfbf-e0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:60:ab,bridge_name='br-int',has_traffic_filtering=True,id=aba97287-1fad-446f-ac84-dba0e2e8112e,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba97287-1f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.objects.instance [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lazy-loading 'pci_devices' on Instance uuid dd06411a-f6dc-4e4a-894f-517410bda71d {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[db97ffa1-8151-493d-bbb4-26e5213df316]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73] added
Jul 25 15:33:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a13a24-ab22-4b8c-b21c-fe5264b1b21a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:33:30 user nova-compute[70869]:   <uuid>dd06411a-f6dc-4e4a-894f-517410bda71d</uuid>
Jul 25 15:33:30 user nova-compute[70869]:   <name>instance-0000000b</name>
Jul 25 15:33:30 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:33:30 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:33:30 user nova-compute[70869]:   <metadata>
Jul 25 15:33:30 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:33:30 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:33:30 user nova-compute[70869]:       <nova:name>tempest-device-tagging-server-182968880</nova:name>
Jul 25 15:33:30 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:33:23</nova:creationTime>
Jul 25 15:33:30 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:33:30 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:33:30 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:33:30 user nova-compute[70869]:       <nova:owner>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:user uuid="fbc9f3d11336441abf6bc378105758d8">tempest-TaggedBootDevicesTest-213145236-project-member</nova:user>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:project uuid="c97ba47b47034968baabdd2f11ba829e">tempest-TaggedBootDevicesTest-213145236</nova:project>
Jul 25 15:33:30 user nova-compute[70869]:       </nova:owner>
Jul 25 15:33:30 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:33:30 user nova-compute[70869]:       <nova:ports>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:port uuid="870b555f-c0da-4f5e-bda0-b7fabc60bf16">
Jul 25 15:33:30 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 15:33:30 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:port uuid="4bddee83-4e25-4ba3-b3d7-4547eeb347ce">
Jul 25 15:33:30 user nova-compute[70869]:           <nova:ip type="fixed" address="10.1.1.148" ipVersion="4"/>
Jul 25 15:33:30 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:port uuid="bbf6f9d2-6384-426f-a998-fb276fa27036">
Jul 25 15:33:30 user nova-compute[70869]:           <nova:ip type="fixed" address="10.1.1.111" ipVersion="4"/>
Jul 25 15:33:30 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:port uuid="897ee821-0b60-41af-86cc-8fb8fcbb63bf">
Jul 25 15:33:30 user nova-compute[70869]:           <nova:ip type="fixed" address="10.1.1.58" ipVersion="4"/>
Jul 25 15:33:30 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:port uuid="4c68f351-19c4-4d47-859c-6de061d29b5e">
Jul 25 15:33:30 user nova-compute[70869]:           <nova:ip type="fixed" address="10.1.1.197" ipVersion="4"/>
Jul 25 15:33:30 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:port uuid="2ebccfbf-e0ec-48fa-be10-4e23441c974b">
Jul 25 15:33:30 user nova-compute[70869]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 25 15:33:30 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:30 user nova-compute[70869]:         <nova:port uuid="aba97287-1fad-446f-ac84-dba0e2e8112e">
Jul 25 15:33:30 user nova-compute[70869]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 25 15:33:30 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:30 user nova-compute[70869]:       </nova:ports>
Jul 25 15:33:30 user nova-compute[70869]:     </nova:instance>
Jul 25 15:33:30 user nova-compute[70869]:   </metadata>
Jul 25 15:33:30 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:33:30 user nova-compute[70869]:     <system>
Jul 25 15:33:30 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:33:30 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:33:30 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:33:30 user nova-compute[70869]:       <entry name="serial">dd06411a-f6dc-4e4a-894f-517410bda71d</entry>
Jul 25 15:33:30 user nova-compute[70869]:       <entry name="uuid">dd06411a-f6dc-4e4a-894f-517410bda71d</entry>
Jul 25 15:33:30 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:33:30 user nova-compute[70869]:     </system>
Jul 25 15:33:30 user nova-compute[70869]:   </sysinfo>
Jul 25 15:33:30 user nova-compute[70869]:   <os>
Jul 25 15:33:30 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:33:30 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:33:30 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:33:30 user nova-compute[70869]:   </os>
Jul 25 15:33:30 user nova-compute[70869]:   <features>
Jul 25 15:33:30 user nova-compute[70869]:     <acpi/>
Jul 25 15:33:30 user nova-compute[70869]:     <apic/>
Jul 25 15:33:30 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:33:30 user nova-compute[70869]:   </features>
Jul 25 15:33:30 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:33:30 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:33:30 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:33:30 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:33:30 user nova-compute[70869]:   </clock>
Jul 25 15:33:30 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:33:30 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:33:30 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:33:30 user nova-compute[70869]:   </cpu>
Jul 25 15:33:30 user nova-compute[70869]:   <devices>
Jul 25 15:33:30 user nova-compute[70869]:     <disk type="file" device="cdrom">
Jul 25 15:33:30 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 15:33:30 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/dd06411a-f6dc-4e4a-894f-517410bda71d/disk.config"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="hda" bus="ide"/>
Jul 25 15:33:30 user nova-compute[70869]:     </disk>
Jul 25 15:33:30 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:33:30 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:33:30 user nova-compute[70869]:       <source dev="/dev/sdb"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <serial>83b11d21-4b1c-4b4c-bcea-8c4d97b5551a</serial>
Jul 25 15:33:30 user nova-compute[70869]:     </disk>
Jul 25 15:33:30 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:33:30 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:33:30 user nova-compute[70869]:       <source dev="/dev/sdd"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <serial>12ff82e7-afb4-48c7-b82b-8c7d85f18491</serial>
Jul 25 15:33:30 user nova-compute[70869]:     </disk>
Jul 25 15:33:30 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:33:30 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:33:30 user nova-compute[70869]:       <source dev="/dev/sdf"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="vdc" bus="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <serial>fed140be-a203-423f-a217-502077c1a262</serial>
Jul 25 15:33:30 user nova-compute[70869]:     </disk>
Jul 25 15:33:30 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:30 user nova-compute[70869]:       <mac address="fa:16:3e:de:3e:3c"/>
Jul 25 15:33:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="tap870b555f-c0"/>
Jul 25 15:33:30 user nova-compute[70869]:     </interface>
Jul 25 15:33:30 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:30 user nova-compute[70869]:       <mac address="fa:16:3e:f3:9d:06"/>
Jul 25 15:33:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="tap4bddee83-4e"/>
Jul 25 15:33:30 user nova-compute[70869]:     </interface>
Jul 25 15:33:30 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:30 user nova-compute[70869]:       <mac address="fa:16:3e:43:d7:16"/>
Jul 25 15:33:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="tapbbf6f9d2-63"/>
Jul 25 15:33:30 user nova-compute[70869]:     </interface>
Jul 25 15:33:30 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:30 user nova-compute[70869]:       <mac address="fa:16:3e:36:f9:28"/>
Jul 25 15:33:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="tap897ee821-0b"/>
Jul 25 15:33:30 user nova-compute[70869]:     </interface>
Jul 25 15:33:30 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:30 user nova-compute[70869]:       <mac address="fa:16:3e:31:9e:c1"/>
Jul 25 15:33:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="tap4c68f351-19"/>
Jul 25 15:33:30 user nova-compute[70869]:     </interface>
Jul 25 15:33:30 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:30 user nova-compute[70869]:       <mac address="fa:16:3e:d4:be:ab"/>
Jul 25 15:33:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="tap2ebccfbf-e0"/>
Jul 25 15:33:30 user nova-compute[70869]:     </interface>
Jul 25 15:33:30 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:30 user nova-compute[70869]:       <mac address="fa:16:3e:cf:60:ab"/>
Jul 25 15:33:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:30 user nova-compute[70869]:       <target dev="tapaba97287-1f"/>
Jul 25 15:33:30 user nova-compute[70869]:     </interface>
Jul 25 15:33:30 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:33:30 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/dd06411a-f6dc-4e4a-894f-517410bda71d/console.log" append="off"/>
Jul 25 15:33:30 user nova-compute[70869]:     </serial>
Jul 25 15:33:30 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:33:30 user nova-compute[70869]:     <video>
Jul 25 15:33:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:30 user nova-compute[70869]:     </video>
Jul 25 15:33:30 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:33:30 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:33:30 user nova-compute[70869]:     </rng>
Jul 25 15:33:30 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:33:30 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:33:30 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:33:30 user nova-compute[70869]:     </memballoon>
Jul 25 15:33:30 user nova-compute[70869]:   </devices>
Jul 25 15:33:30 user nova-compute[70869]: </domain>
Jul 25 15:33:30 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:3c,bridge_name='br-int',has_traffic_filtering=True,id=870b555f-c0da-4f5e-bda0-b7fabc60bf16,network=Network(95965bd0-a6d1-4725-ba2b-ef035c839102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870b555f-c0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:3c,bridge_name='br-int',has_traffic_filtering=True,id=870b555f-c0da-4f5e-bda0-b7fabc60bf16,network=Network(95965bd0-a6d1-4725-ba2b-ef035c839102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870b555f-c0') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap870b555f-c0, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap870b555f-c0, col_values=(('external_ids', {'iface-id': '870b555f-c0da-4f5e-bda0-b7fabc60bf16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:3e:3c', 'vm-uuid': 'dd06411a-f6dc-4e4a-894f-517410bda71d'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7720f955-057f-4196-b743-ced0457d38dc]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: INFO os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:3c,bridge_name='br-int',has_traffic_filtering=True,id=870b555f-c0da-4f5e-bda0-b7fabc60bf16,network=Network(95965bd0-a6d1-4725-ba2b-ef035c839102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870b555f-c0')
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=4bddee83-4e25-4ba3-b3d7-4547eeb347ce,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bddee83-4e') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=4bddee83-4e25-4ba3-b3d7-4547eeb347ce,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bddee83-4e') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dRNIvZqP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bddee83-4e, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bddee83-4e, col_values=(('external_ids', {'iface-id': '4bddee83-4e25-4ba3-b3d7-4547eeb347ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:9d:06', 'vm-uuid': 'dd06411a-f6dc-4e4a-894f-517410bda71d'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dRNIvZqP" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a16bc3-9b2e-49df-8f79-9d00bafbc406]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dRNIvZqP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: INFO os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=4bddee83-4e25-4ba3-b3d7-4547eeb347ce,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bddee83-4e')
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:16,bridge_name='br-int',has_traffic_filtering=True,id=bbf6f9d2-6384-426f-a998-fb276fa27036,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf6f9d2-63') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:16,bridge_name='br-int',has_traffic_filtering=True,id=bbf6f9d2-6384-426f-a998-fb276fa27036,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf6f9d2-63') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbf6f9d2-63, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbbf6f9d2-63, col_values=(('external_ids', {'iface-id': 'bbf6f9d2-6384-426f-a998-fb276fa27036', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:d7:16', 'vm-uuid': 'dd06411a-f6dc-4e4a-894f-517410bda71d'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbca4b2-95af-4565-833a-58f8e4c3e8b7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[472d322e-6614-4ad5-8c70-9cc6f3d9ea2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: INFO os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:16,bridge_name='br-int',has_traffic_filtering=True,id=bbf6f9d2-6384-426f-a998-fb276fa27036,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf6f9d2-63')
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f9:28,bridge_name='br-int',has_traffic_filtering=True,id=897ee821-0b60-41af-86cc-8fb8fcbb63bf,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897ee821-0b') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f9:28,bridge_name='br-int',has_traffic_filtering=True,id=897ee821-0b60-41af-86cc-8fb8fcbb63bf,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897ee821-0b') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap897ee821-0b, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap897ee821-0b, col_values=(('external_ids', {'iface-id': '897ee821-0b60-41af-86cc-8fb8fcbb63bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f9:28', 'vm-uuid': 'dd06411a-f6dc-4e4a-894f-517410bda71d'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: INFO os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f9:28,bridge_name='br-int',has_traffic_filtering=True,id=897ee821-0b60-41af-86cc-8fb8fcbb63bf,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897ee821-0b')
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:9e:c1,bridge_name='br-int',has_traffic_filtering=True,id=4c68f351-19c4-4d47-859c-6de061d29b5e,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c68f351-19') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:9e:c1,bridge_name='br-int',has_traffic_filtering=True,id=4c68f351-19c4-4d47-859c-6de061d29b5e,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c68f351-19') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c68f351-19, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c68f351-19, col_values=(('external_ids', {'iface-id': '4c68f351-19c4-4d47-859c-6de061d29b5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:9e:c1', 'vm-uuid': 'dd06411a-f6dc-4e4a-894f-517410bda71d'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9400e8c0-ebf5-455d-af50-77dc300e4fa4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73, portal: 172.16.0.220,3260]
Jul 25 15:33:30 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73, portal: 172.16.0.220,3260] successful.
Jul 25 15:33:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[45942888-a880-4c01-8e00-3929ac86a1d0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:30 user nova-compute[70869]: INFO os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:9e:c1,bridge_name='br-int',has_traffic_filtering=True,id=4c68f351-19c4-4d47-859c-6de061d29b5e,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c68f351-19')
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:be:ab,bridge_name='br-int',has_traffic_filtering=True,id=2ebccfbf-e0ec-48fa-be10-4e23441c974b,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebccfbf-e0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:be:ab,bridge_name='br-int',has_traffic_filtering=True,id=2ebccfbf-e0ec-48fa-be10-4e23441c974b,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebccfbf-e0') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ebccfbf-e0, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ebccfbf-e0, col_values=(('external_ids', {'iface-id': '2ebccfbf-e0ec-48fa-be10-4e23441c974b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:be:ab', 'vm-uuid': 'dd06411a-f6dc-4e4a-894f-517410bda71d'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3571d7c4-6034-46f3-8731-ef8eba88661d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:33:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[867932dc-d3c6-45d2-b6ce-a481cba7e573]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRNIvZqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: INFO os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:be:ab,bridge_name='br-int',has_traffic_filtering=True,id=2ebccfbf-e0ec-48fa-be10-4e23441c974b,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebccfbf-e0')
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:60:ab,bridge_name='br-int',has_traffic_filtering=True,id=aba97287-1fad-446f-ac84-dba0e2e8112e,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba97287-1f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:60:ab,bridge_name='br-int',has_traffic_filtering=True,id=aba97287-1fad-446f-ac84-dba0e2e8112e,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba97287-1f') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaba97287-1f, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaba97287-1f, col_values=(('external_ids', {'iface-id': 'aba97287-1fad-446f-ac84-dba0e2e8112e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:60:ab', 'vm-uuid': 'dd06411a-f6dc-4e4a-894f-517410bda71d'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:30 user nova-compute[70869]: INFO os_vif [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:60:ab,bridge_name='br-int',has_traffic_filtering=True,id=aba97287-1fad-446f-ac84-dba0e2e8112e,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba97287-1f')
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] No BDM found with device name hda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] No VIF found with MAC fa:16:3e:de:3e:3c, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] No VIF found with MAC fa:16:3e:31:9e:c1, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:33:30 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Using config drive
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:30 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Creating config drive at /opt/stack/data/nova/instances/dd06411a-f6dc-4e4a-894f-517410bda71d/disk.config
Jul 25 15:33:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dd06411a-f6dc-4e4a-894f-517410bda71d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptety1045 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dd06411a-f6dc-4e4a-894f-517410bda71d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptety1045" returned: 0 in 0.076s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] <== connect_volume: return (2833ms) {'type': 'block', 'scsi_wwn': '23136323864303437', 'path': '/dev/sdg'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136323864303437', 'path': '/dev/sdg'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:3c:67,bridge_name='br-int',has_traffic_filtering=True,id=f826bc9f-7358-4bac-9f9a-7fd060b7d350,network=Network(f21d0268-cb65-4a8c-9617-310edaa41ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf826bc9f-73') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=20bd65f0-1d1d-4c3c-a7eb-4712eef84404,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20bd65f0-1d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=5b3e2d62-2cb8-4c19-8edd-1ae36bdced65,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b3e2d62-2c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:59:13,bridge_name='br-int',has_traffic_filtering=True,id=5ae3ba86-1b57-403c-ab34-9f65aff4c95e,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae3ba86-1b') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:db:1c,bridge_name='br-int',has_traffic_filtering=True,id=84f5c4a8-261e-4d46-add2-78f955d2d6cc,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f5c4a8-26') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:dd:a2,bridge_name='br-int',has_traffic_filtering=True,id=5e1ad59c-808c-4702-acdc-b95a29dbb164,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1ad59c-80') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:62,bridge_name='br-int',has_traffic_filtering=True,id=56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b1eda8-f8') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.objects.instance [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lazy-loading 'pci_devices' on Instance uuid da94f076-89f8-40be-b8bb-f4f8a73953ae {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:33:31 user nova-compute[70869]:   <uuid>da94f076-89f8-40be-b8bb-f4f8a73953ae</uuid>
Jul 25 15:33:31 user nova-compute[70869]:   <name>instance-0000000c</name>
Jul 25 15:33:31 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:33:31 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:33:31 user nova-compute[70869]:   <metadata>
Jul 25 15:33:31 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:33:31 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:33:31 user nova-compute[70869]:       <nova:name>tempest-device-tagging-server-1341946241</nova:name>
Jul 25 15:33:31 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:33:23</nova:creationTime>
Jul 25 15:33:31 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:33:31 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:33:31 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:33:31 user nova-compute[70869]:       <nova:owner>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:user uuid="0980deba3f4e4b6e8ef276d2502e7bfb">tempest-TaggedBootDevicesTest_v242-820690677-project-member</nova:user>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:project uuid="9b435a0b68ec412388fb4d85e0df701e">tempest-TaggedBootDevicesTest_v242-820690677</nova:project>
Jul 25 15:33:31 user nova-compute[70869]:       </nova:owner>
Jul 25 15:33:31 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:33:31 user nova-compute[70869]:       <nova:ports>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:port uuid="f826bc9f-7358-4bac-9f9a-7fd060b7d350">
Jul 25 15:33:31 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 15:33:31 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:port uuid="20bd65f0-1d1d-4c3c-a7eb-4712eef84404">
Jul 25 15:33:31 user nova-compute[70869]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
Jul 25 15:33:31 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:port uuid="5b3e2d62-2cb8-4c19-8edd-1ae36bdced65">
Jul 25 15:33:31 user nova-compute[70869]:           <nova:ip type="fixed" address="10.1.1.173" ipVersion="4"/>
Jul 25 15:33:31 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:port uuid="5ae3ba86-1b57-403c-ab34-9f65aff4c95e">
Jul 25 15:33:31 user nova-compute[70869]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Jul 25 15:33:31 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:port uuid="84f5c4a8-261e-4d46-add2-78f955d2d6cc">
Jul 25 15:33:31 user nova-compute[70869]:           <nova:ip type="fixed" address="10.1.1.196" ipVersion="4"/>
Jul 25 15:33:31 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:port uuid="5e1ad59c-808c-4702-acdc-b95a29dbb164">
Jul 25 15:33:31 user nova-compute[70869]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 25 15:33:31 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:31 user nova-compute[70869]:         <nova:port uuid="56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d">
Jul 25 15:33:31 user nova-compute[70869]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 25 15:33:31 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:31 user nova-compute[70869]:       </nova:ports>
Jul 25 15:33:31 user nova-compute[70869]:     </nova:instance>
Jul 25 15:33:31 user nova-compute[70869]:   </metadata>
Jul 25 15:33:31 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:33:31 user nova-compute[70869]:     <system>
Jul 25 15:33:31 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:33:31 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:33:31 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:33:31 user nova-compute[70869]:       <entry name="serial">da94f076-89f8-40be-b8bb-f4f8a73953ae</entry>
Jul 25 15:33:31 user nova-compute[70869]:       <entry name="uuid">da94f076-89f8-40be-b8bb-f4f8a73953ae</entry>
Jul 25 15:33:31 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:33:31 user nova-compute[70869]:     </system>
Jul 25 15:33:31 user nova-compute[70869]:   </sysinfo>
Jul 25 15:33:31 user nova-compute[70869]:   <os>
Jul 25 15:33:31 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:33:31 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:33:31 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:33:31 user nova-compute[70869]:   </os>
Jul 25 15:33:31 user nova-compute[70869]:   <features>
Jul 25 15:33:31 user nova-compute[70869]:     <acpi/>
Jul 25 15:33:31 user nova-compute[70869]:     <apic/>
Jul 25 15:33:31 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:33:31 user nova-compute[70869]:   </features>
Jul 25 15:33:31 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:33:31 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:33:31 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:33:31 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:33:31 user nova-compute[70869]:   </clock>
Jul 25 15:33:31 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:33:31 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:33:31 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:33:31 user nova-compute[70869]:   </cpu>
Jul 25 15:33:31 user nova-compute[70869]:   <devices>
Jul 25 15:33:31 user nova-compute[70869]:     <disk type="file" device="cdrom">
Jul 25 15:33:31 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none"/>
Jul 25 15:33:31 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/da94f076-89f8-40be-b8bb-f4f8a73953ae/disk.config"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="hda" bus="ide"/>
Jul 25 15:33:31 user nova-compute[70869]:     </disk>
Jul 25 15:33:31 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:33:31 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:33:31 user nova-compute[70869]:       <source dev="/dev/sdc"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <serial>17bd7b79-d155-49ef-a6dd-a3b8826067b1</serial>
Jul 25 15:33:31 user nova-compute[70869]:     </disk>
Jul 25 15:33:31 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:33:31 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:33:31 user nova-compute[70869]:       <source dev="/dev/sde"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <serial>5d211ee9-c939-419e-88ae-dfd771f027b9</serial>
Jul 25 15:33:31 user nova-compute[70869]:     </disk>
Jul 25 15:33:31 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:33:31 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:33:31 user nova-compute[70869]:       <source dev="/dev/sdg"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="vdc" bus="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <serial>88223f23-8512-4177-baa6-9a1dbec47f73</serial>
Jul 25 15:33:31 user nova-compute[70869]:     </disk>
Jul 25 15:33:31 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:31 user nova-compute[70869]:       <mac address="fa:16:3e:d0:3c:67"/>
Jul 25 15:33:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="tapf826bc9f-73"/>
Jul 25 15:33:31 user nova-compute[70869]:     </interface>
Jul 25 15:33:31 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:31 user nova-compute[70869]:       <mac address="fa:16:3e:cd:0d:d3"/>
Jul 25 15:33:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="tap20bd65f0-1d"/>
Jul 25 15:33:31 user nova-compute[70869]:     </interface>
Jul 25 15:33:31 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:31 user nova-compute[70869]:       <mac address="fa:16:3e:32:2e:46"/>
Jul 25 15:33:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="tap5b3e2d62-2c"/>
Jul 25 15:33:31 user nova-compute[70869]:     </interface>
Jul 25 15:33:31 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:31 user nova-compute[70869]:       <mac address="fa:16:3e:31:59:13"/>
Jul 25 15:33:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="tap5ae3ba86-1b"/>
Jul 25 15:33:31 user nova-compute[70869]:     </interface>
Jul 25 15:33:31 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:31 user nova-compute[70869]:       <mac address="fa:16:3e:6a:db:1c"/>
Jul 25 15:33:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="tap84f5c4a8-26"/>
Jul 25 15:33:31 user nova-compute[70869]:     </interface>
Jul 25 15:33:31 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:31 user nova-compute[70869]:       <mac address="fa:16:3e:25:dd:a2"/>
Jul 25 15:33:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="tap5e1ad59c-80"/>
Jul 25 15:33:31 user nova-compute[70869]:     </interface>
Jul 25 15:33:31 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:31 user nova-compute[70869]:       <mac address="fa:16:3e:bf:77:62"/>
Jul 25 15:33:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:31 user nova-compute[70869]:       <target dev="tap56b1eda8-f8"/>
Jul 25 15:33:31 user nova-compute[70869]:     </interface>
Jul 25 15:33:31 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:33:31 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/da94f076-89f8-40be-b8bb-f4f8a73953ae/console.log" append="off"/>
Jul 25 15:33:31 user nova-compute[70869]:     </serial>
Jul 25 15:33:31 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:33:31 user nova-compute[70869]:     <video>
Jul 25 15:33:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:31 user nova-compute[70869]:     </video>
Jul 25 15:33:31 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:33:31 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:33:31 user nova-compute[70869]:     </rng>
Jul 25 15:33:31 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:33:31 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:33:31 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:33:31 user nova-compute[70869]:     </memballoon>
Jul 25 15:33:31 user nova-compute[70869]:   </devices>
Jul 25 15:33:31 user nova-compute[70869]: </domain>
Jul 25 15:33:31 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:3c:67,bridge_name='br-int',has_traffic_filtering=True,id=f826bc9f-7358-4bac-9f9a-7fd060b7d350,network=Network(f21d0268-cb65-4a8c-9617-310edaa41ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf826bc9f-73') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:3c:67,bridge_name='br-int',has_traffic_filtering=True,id=f826bc9f-7358-4bac-9f9a-7fd060b7d350,network=Network(f21d0268-cb65-4a8c-9617-310edaa41ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf826bc9f-73') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf826bc9f-73, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf826bc9f-73, col_values=(('external_ids', {'iface-id': 'f826bc9f-7358-4bac-9f9a-7fd060b7d350', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:3c:67', 'vm-uuid': 'da94f076-89f8-40be-b8bb-f4f8a73953ae'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:31 user nova-compute[70869]: INFO os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:3c:67,bridge_name='br-int',has_traffic_filtering=True,id=f826bc9f-7358-4bac-9f9a-7fd060b7d350,network=Network(f21d0268-cb65-4a8c-9617-310edaa41ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf826bc9f-73')
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=20bd65f0-1d1d-4c3c-a7eb-4712eef84404,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20bd65f0-1d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=20bd65f0-1d1d-4c3c-a7eb-4712eef84404,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20bd65f0-1d') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20bd65f0-1d, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20bd65f0-1d, col_values=(('external_ids', {'iface-id': '20bd65f0-1d1d-4c3c-a7eb-4712eef84404', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:0d:d3', 'vm-uuid': 'da94f076-89f8-40be-b8bb-f4f8a73953ae'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: INFO os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=20bd65f0-1d1d-4c3c-a7eb-4712eef84404,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20bd65f0-1d')
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=5b3e2d62-2cb8-4c19-8edd-1ae36bdced65,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b3e2d62-2c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=5b3e2d62-2cb8-4c19-8edd-1ae36bdced65,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b3e2d62-2c') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b3e2d62-2c, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b3e2d62-2c, col_values=(('external_ids', {'iface-id': '5b3e2d62-2cb8-4c19-8edd-1ae36bdced65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:2e:46', 'vm-uuid': 'da94f076-89f8-40be-b8bb-f4f8a73953ae'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:32 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:33:32 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=6872MB free_disk=25.781387329101562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: INFO os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=5b3e2d62-2cb8-4c19-8edd-1ae36bdced65,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b3e2d62-2c')
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:59:13,bridge_name='br-int',has_traffic_filtering=True,id=5ae3ba86-1b57-403c-ab34-9f65aff4c95e,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae3ba86-1b') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:59:13,bridge_name='br-int',has_traffic_filtering=True,id=5ae3ba86-1b57-403c-ab34-9f65aff4c95e,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae3ba86-1b') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ae3ba86-1b, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ae3ba86-1b, col_values=(('external_ids', {'iface-id': '5ae3ba86-1b57-403c-ab34-9f65aff4c95e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:59:13', 'vm-uuid': 'da94f076-89f8-40be-b8bb-f4f8a73953ae'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bb1bf680-5ab7-4210-b3d1-44fe0775a9ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fa170559-5228-448f-acea-c5b816a22631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 08fa2836-717a-4893-8969-fcab677935a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3a84f092-352e-4039-8dcb-bd4578458765 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance dd06411a-f6dc-4e4a-894f-517410bda71d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance da94f076-89f8-40be-b8bb-f4f8a73953ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-d317855b-6b57-4efb-9aeb-95c8d29343c2 req-3c905c62-162c-4a2c-8f65-7270d614024a service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d317855b-6b57-4efb-9aeb-95c8d29343c2 req-3c905c62-162c-4a2c-8f65-7270d614024a service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d317855b-6b57-4efb-9aeb-95c8d29343c2 req-3c905c62-162c-4a2c-8f65-7270d614024a service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d317855b-6b57-4efb-9aeb-95c8d29343c2 req-3c905c62-162c-4a2c-8f65-7270d614024a service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-d317855b-6b57-4efb-9aeb-95c8d29343c2 req-3c905c62-162c-4a2c-8f65-7270d614024a service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:32 user nova-compute[70869]: WARNING nova.compute.manager [req-d317855b-6b57-4efb-9aeb-95c8d29343c2 req-3c905c62-162c-4a2c-8f65-7270d614024a service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 for instance with vm_state building and task_state spawning.
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: INFO os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:59:13,bridge_name='br-int',has_traffic_filtering=True,id=5ae3ba86-1b57-403c-ab34-9f65aff4c95e,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae3ba86-1b')
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:db:1c,bridge_name='br-int',has_traffic_filtering=True,id=84f5c4a8-261e-4d46-add2-78f955d2d6cc,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f5c4a8-26') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:db:1c,bridge_name='br-int',has_traffic_filtering=True,id=84f5c4a8-261e-4d46-add2-78f955d2d6cc,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f5c4a8-26') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84f5c4a8-26, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84f5c4a8-26, col_values=(('external_ids', {'iface-id': '84f5c4a8-261e-4d46-add2-78f955d2d6cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:db:1c', 'vm-uuid': 'da94f076-89f8-40be-b8bb-f4f8a73953ae'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: INFO os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:db:1c,bridge_name='br-int',has_traffic_filtering=True,id=84f5c4a8-261e-4d46-add2-78f955d2d6cc,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f5c4a8-26')
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:dd:a2,bridge_name='br-int',has_traffic_filtering=True,id=5e1ad59c-808c-4702-acdc-b95a29dbb164,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1ad59c-80') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:dd:a2,bridge_name='br-int',has_traffic_filtering=True,id=5e1ad59c-808c-4702-acdc-b95a29dbb164,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1ad59c-80') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e1ad59c-80, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e1ad59c-80, col_values=(('external_ids', {'iface-id': '5e1ad59c-808c-4702-acdc-b95a29dbb164', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:dd:a2', 'vm-uuid': 'da94f076-89f8-40be-b8bb-f4f8a73953ae'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: INFO os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:dd:a2,bridge_name='br-int',has_traffic_filtering=True,id=5e1ad59c-808c-4702-acdc-b95a29dbb164,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1ad59c-80')
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:62,bridge_name='br-int',has_traffic_filtering=True,id=56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b1eda8-f8') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:62,bridge_name='br-int',has_traffic_filtering=True,id=56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b1eda8-f8') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56b1eda8-f8, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56b1eda8-f8, col_values=(('external_ids', {'iface-id': '56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:77:62', 'vm-uuid': 'da94f076-89f8-40be-b8bb-f4f8a73953ae'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-6f6d5ff2-056c-47e3-a9b0-616631c598e4 req-766d28b5-7f00-4eca-88ef-79e381c9f04b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6f6d5ff2-056c-47e3-a9b0-616631c598e4 req-766d28b5-7f00-4eca-88ef-79e381c9f04b service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6f6d5ff2-056c-47e3-a9b0-616631c598e4 req-766d28b5-7f00-4eca-88ef-79e381c9f04b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6f6d5ff2-056c-47e3-a9b0-616631c598e4 req-766d28b5-7f00-4eca-88ef-79e381c9f04b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-6f6d5ff2-056c-47e3-a9b0-616631c598e4 req-766d28b5-7f00-4eca-88ef-79e381c9f04b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:33 user nova-compute[70869]: WARNING nova.compute.manager [req-6f6d5ff2-056c-47e3-a9b0-616631c598e4 req-766d28b5-7f00-4eca-88ef-79e381c9f04b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce for instance with vm_state building and task_state spawning.
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: INFO os_vif [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:62,bridge_name='br-int',has_traffic_filtering=True,id=56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b1eda8-f8')
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] No BDM found with device name hda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] No VIF found with MAC fa:16:3e:d0:3c:67, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] No VIF found with MAC fa:16:3e:6a:db:1c, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:33:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Using config drive
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:33:33 user nova-compute[70869]: INFO nova.compute.claims [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Claim successful on node user
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-2c2b2d2b-bc6c-4a36-9ca4-ccb3f061378c req-374f37d4-5819-4179-89ed-a6e0c48aa06c service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2c2b2d2b-bc6c-4a36-9ca4-ccb3f061378c req-374f37d4-5819-4179-89ed-a6e0c48aa06c service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2c2b2d2b-bc6c-4a36-9ca4-ccb3f061378c req-374f37d4-5819-4179-89ed-a6e0c48aa06c service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2c2b2d2b-bc6c-4a36-9ca4-ccb3f061378c req-374f37d4-5819-4179-89ed-a6e0c48aa06c service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-2c2b2d2b-bc6c-4a36-9ca4-ccb3f061378c req-374f37d4-5819-4179-89ed-a6e0c48aa06c service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:33 user nova-compute[70869]: WARNING nova.compute.manager [req-2c2b2d2b-bc6c-4a36-9ca4-ccb3f061378c req-374f37d4-5819-4179-89ed-a6e0c48aa06c service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf for instance with vm_state building and task_state spawning.
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Creating config drive at /opt/stack/data/nova/instances/da94f076-89f8-40be-b8bb-f4f8a73953ae/disk.config
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/da94f076-89f8-40be-b8bb-f4f8a73953ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1nx0bipn {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/da94f076-89f8-40be-b8bb-f4f8a73953ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1nx0bipn" returned: 0 in 0.076s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:34 user nova-compute[70869]: WARNING nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 for instance with vm_state building and task_state spawning.
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:34 user nova-compute[70869]: WARNING nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-bbf6f9d2-6384-426f-a998-fb276fa27036 for instance with vm_state building and task_state spawning.
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:34 user nova-compute[70869]: WARNING nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-bbf6f9d2-6384-426f-a998-fb276fa27036 for instance with vm_state building and task_state spawning.
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:34 user nova-compute[70869]: WARNING nova.compute.manager [req-51dfa4b4-bcd3-464c-bc94-f3312a4d7217 req-1305de83-c30f-4092-bfb1-47635432df20 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-4c68f351-19c4-4d47-859c-6de061d29b5e for instance with vm_state building and task_state spawning.
Jul 25 15:33:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.policy [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47d1f853b9564b8ca6e60577241fed35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e50fe153def490bae620115f0dc4b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:33:35 user nova-compute[70869]: INFO nova.compute.manager [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] instance snapshotting
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:33:35 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Creating image(s)
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "/opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "/opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "/opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:35 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Beginning live snapshot process
Jul 25 15:33:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk 1073741824" returned: 0 in 0.070s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-18a06b8f-c7cf-4548-87a8-48d431f3eb55 req-46cb752b-43bb-4fae-9bde-15d96afcd633 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-18a06b8f-c7cf-4548-87a8-48d431f3eb55 req-46cb752b-43bb-4fae-9bde-15d96afcd633 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-18a06b8f-c7cf-4548-87a8-48d431f3eb55 req-46cb752b-43bb-4fae-9bde-15d96afcd633 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-18a06b8f-c7cf-4548-87a8-48d431f3eb55 req-46cb752b-43bb-4fae-9bde-15d96afcd633 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-18a06b8f-c7cf-4548-87a8-48d431f3eb55 req-46cb752b-43bb-4fae-9bde-15d96afcd633 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:35 user nova-compute[70869]: WARNING nova.compute.manager [req-18a06b8f-c7cf-4548-87a8-48d431f3eb55 req-46cb752b-43bb-4fae-9bde-15d96afcd633 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce for instance with vm_state building and task_state spawning.
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json -f qcow2 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.005s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lazy-loading 'flavor' on Instance uuid bb1bf680-5ab7-4210-b3d1-44fe0775a9ca {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json -f qcow2 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Cannot resize image /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lazy-loading 'migration_context' on Instance uuid 1093381e-c322-4ed0-91cb-1a8e956f8dfd {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Ensure instance console log exists: /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json -f qcow2" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:35 user nova-compute[70869]: INFO nova.compute.manager [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Attaching volume a57284f5-ed77-4f4a-ba30-f21180b3cb1b to /dev/vdb
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-766a230d-6332-400a-9ce2-68924b0af14f req-c64af9e2-4d62-49ee-b63a-66d7a5a32e91 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-766a230d-6332-400a-9ce2-68924b0af14f req-c64af9e2-4d62-49ee-b63a-66d7a5a32e91 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-766a230d-6332-400a-9ce2-68924b0af14f req-c64af9e2-4d62-49ee-b63a-66d7a5a32e91 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-766a230d-6332-400a-9ce2-68924b0af14f req-c64af9e2-4d62-49ee-b63a-66d7a5a32e91 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-766a230d-6332-400a-9ce2-68924b0af14f req-c64af9e2-4d62-49ee-b63a-66d7a5a32e91 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:35 user nova-compute[70869]: WARNING nova.compute.manager [req-766a230d-6332-400a-9ce2-68924b0af14f req-c64af9e2-4d62-49ee-b63a-66d7a5a32e91 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf for instance with vm_state building and task_state spawning.
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Successfully created port: 5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.178s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzv49_xhq/f5ed4ac0a0fb49d8b3f3bb3b1169a9a8.delta 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG os_brick.utils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5963cb69-7513-4672-b7dd-3b198469b454]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[72be4403-c8f7-4a60-ba43-b47c39efc2f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzv49_xhq/f5ed4ac0a0fb49d8b3f3bb3b1169a9a8.delta 1073741824" returned: 0 in 0.089s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:36 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70869) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 25 15:33:36 user nova-compute[70869]: INFO nova.virt.libvirt.host [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] UEFI support detected
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ce0f3d-dfaa-42ec-81c4-08ceea74fd0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4831c0-eb55-42a7-8733-ca076a054719]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:36 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80a6cda-8a15-4ad6-8e73-340373825fad]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG os_brick.utils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Updating existing volume attachment record: 08700bbc-8e7a-44cf-baec-834ec8805403 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:36 user nova-compute[70869]: WARNING nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-4c68f351-19c4-4d47-859c-6de061d29b5e for instance with vm_state building and task_state spawning.
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:36 user nova-compute[70869]: WARNING nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b for instance with vm_state building and task_state spawning.
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:36 user nova-compute[70869]: WARNING nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b for instance with vm_state building and task_state spawning.
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:36 user nova-compute[70869]: WARNING nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-aba97287-1fad-446f-ac84-dba0e2e8112e for instance with vm_state building and task_state spawning.
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:36 user nova-compute[70869]: WARNING nova.compute.manager [req-dbb513c7-8c27-4b57-a9e4-b4a45639a122 req-4a518acb-4840-48ff-8280-64b573b76f2b service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-aba97287-1fad-446f-ac84-dba0e2e8112e for instance with vm_state building and task_state spawning.
Jul 25 15:33:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] COPY block job progress, current cursor: 1114112 final cursor: 75497472 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:33:36 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Successfully updated port: 5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "refresh_cache-1093381e-c322-4ed0-91cb-1a8e956f8dfd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquired lock "refresh_cache-1093381e-c322-4ed0-91cb-1a8e956f8dfd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:33:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Updating instance_info_cache with network_info: [{"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Releasing lock "refresh_cache-1093381e-c322-4ed0-91cb-1a8e956f8dfd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Instance network_info: |[{"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Start _get_guest_xml network_info=[{"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:33:37 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:33:37 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-365092138',display_name='tempest-ServersNegativeTestJSON-server-365092138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-365092138',id=13,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e50fe153def490bae620115f0dc4b50',ramdisk_id='',reservation_id='r-d0641y9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-454996836',owner_user_name='tempest-ServersNegativeTestJSON-454996836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:35Z,user_data=None,user_id='47d1f853b9564b8ca6e60577241fed35',uuid=1093381e-c322-4ed0-91cb-1a8e956f8dfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converting VIF {"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=5e1b7502-6d07-4969-8e5a-6799f133a9c6,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1b7502-6d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lazy-loading 'pci_devices' on Instance uuid 1093381e-c322-4ed0-91cb-1a8e956f8dfd {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:33:37 user nova-compute[70869]:   <uuid>1093381e-c322-4ed0-91cb-1a8e956f8dfd</uuid>
Jul 25 15:33:37 user nova-compute[70869]:   <name>instance-0000000d</name>
Jul 25 15:33:37 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:33:37 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:33:37 user nova-compute[70869]:   <metadata>
Jul 25 15:33:37 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:33:37 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:33:37 user nova-compute[70869]:       <nova:name>tempest-ServersNegativeTestJSON-server-365092138</nova:name>
Jul 25 15:33:37 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:33:37</nova:creationTime>
Jul 25 15:33:37 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:33:37 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:33:37 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:33:37 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:33:37 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:33:37 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:33:37 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:33:37 user nova-compute[70869]:       <nova:owner>
Jul 25 15:33:37 user nova-compute[70869]:         <nova:user uuid="47d1f853b9564b8ca6e60577241fed35">tempest-ServersNegativeTestJSON-454996836-project-member</nova:user>
Jul 25 15:33:37 user nova-compute[70869]:         <nova:project uuid="5e50fe153def490bae620115f0dc4b50">tempest-ServersNegativeTestJSON-454996836</nova:project>
Jul 25 15:33:37 user nova-compute[70869]:       </nova:owner>
Jul 25 15:33:37 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:33:37 user nova-compute[70869]:       <nova:ports>
Jul 25 15:33:37 user nova-compute[70869]:         <nova:port uuid="5e1b7502-6d07-4969-8e5a-6799f133a9c6">
Jul 25 15:33:37 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 15:33:37 user nova-compute[70869]:         </nova:port>
Jul 25 15:33:37 user nova-compute[70869]:       </nova:ports>
Jul 25 15:33:37 user nova-compute[70869]:     </nova:instance>
Jul 25 15:33:37 user nova-compute[70869]:   </metadata>
Jul 25 15:33:37 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:33:37 user nova-compute[70869]:     <system>
Jul 25 15:33:37 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:33:37 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:33:37 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:33:37 user nova-compute[70869]:       <entry name="serial">1093381e-c322-4ed0-91cb-1a8e956f8dfd</entry>
Jul 25 15:33:37 user nova-compute[70869]:       <entry name="uuid">1093381e-c322-4ed0-91cb-1a8e956f8dfd</entry>
Jul 25 15:33:37 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:33:37 user nova-compute[70869]:     </system>
Jul 25 15:33:37 user nova-compute[70869]:   </sysinfo>
Jul 25 15:33:37 user nova-compute[70869]:   <os>
Jul 25 15:33:37 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:33:37 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:33:37 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:33:37 user nova-compute[70869]:   </os>
Jul 25 15:33:37 user nova-compute[70869]:   <features>
Jul 25 15:33:37 user nova-compute[70869]:     <acpi/>
Jul 25 15:33:37 user nova-compute[70869]:     <apic/>
Jul 25 15:33:37 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:33:37 user nova-compute[70869]:   </features>
Jul 25 15:33:37 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:33:37 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:33:37 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:33:37 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:33:37 user nova-compute[70869]:   </clock>
Jul 25 15:33:37 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:33:37 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:33:37 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:33:37 user nova-compute[70869]:   </cpu>
Jul 25 15:33:37 user nova-compute[70869]:   <devices>
Jul 25 15:33:37 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:33:37 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:33:37 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk"/>
Jul 25 15:33:37 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:33:37 user nova-compute[70869]:     </disk>
Jul 25 15:33:37 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:33:37 user nova-compute[70869]:       <mac address="fa:16:3e:8b:1d:cc"/>
Jul 25 15:33:37 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:37 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:33:37 user nova-compute[70869]:       <target dev="tap5e1b7502-6d"/>
Jul 25 15:33:37 user nova-compute[70869]:     </interface>
Jul 25 15:33:37 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:33:37 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/console.log" append="off"/>
Jul 25 15:33:37 user nova-compute[70869]:     </serial>
Jul 25 15:33:37 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:33:37 user nova-compute[70869]:     <video>
Jul 25 15:33:37 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:33:37 user nova-compute[70869]:     </video>
Jul 25 15:33:37 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:33:37 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:33:37 user nova-compute[70869]:     </rng>
Jul 25 15:33:37 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:33:37 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:33:37 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:33:37 user nova-compute[70869]:     </memballoon>
Jul 25 15:33:37 user nova-compute[70869]:   </devices>
Jul 25 15:33:37 user nova-compute[70869]: </domain>
Jul 25 15:33:37 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-365092138',display_name='tempest-ServersNegativeTestJSON-server-365092138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-365092138',id=13,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e50fe153def490bae620115f0dc4b50',ramdisk_id='',reservation_id='r-d0641y9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-454996836',owner_user_name='tempest-ServersNegativeTestJSON-454996836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:35Z,user_data=None,user_id='47d1f853b9564b8ca6e60577241fed35',uuid=1093381e-c322-4ed0-91cb-1a8e956f8dfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converting VIF {"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=5e1b7502-6d07-4969-8e5a-6799f133a9c6,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1b7502-6d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG os_vif [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=5e1b7502-6d07-4969-8e5a-6799f133a9c6,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1b7502-6d') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e1b7502-6d, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e1b7502-6d, col_values=(('external_ids', {'iface-id': '5e1b7502-6d07-4969-8e5a-6799f133a9c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:1d:cc', 'vm-uuid': '1093381e-c322-4ed0-91cb-1a8e956f8dfd'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzv49_xhq/f5ed4ac0a0fb49d8b3f3bb3b1169a9a8.delta /opt/stack/data/nova/instances/snapshots/tmpzv49_xhq/f5ed4ac0a0fb49d8b3f3bb3b1169a9a8 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:37 user nova-compute[70869]: INFO os_vif [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=5e1b7502-6d07-4969-8e5a-6799f133a9c6,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1b7502-6d')
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] No VIF found with MAC fa:16:3e:8b:1d:cc, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:37 user nova-compute[70869]: WARNING nova.compute.manager [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 for instance with vm_state building and task_state spawning.
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:37 user nova-compute[70869]: WARNING nova.compute.manager [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 for instance with vm_state building and task_state spawning.
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:37 user nova-compute[70869]: WARNING nova.compute.manager [req-301b4249-c831-4184-898d-b4e8cf84ebaa req-d9f20723-5562-4bbf-9fcf-e0ccfc00d4b7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 for instance with vm_state building and task_state spawning.
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzv49_xhq/f5ed4ac0a0fb49d8b3f3bb3b1169a9a8.delta /opt/stack/data/nova/instances/snapshots/tmpzv49_xhq/f5ed4ac0a0fb49d8b3f3bb3b1169a9a8" returned: 0 in 0.520s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:38 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Snapshot extracted, beginning image upload
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received event network-changed-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Refreshing instance network info cache due to event network-changed-5e1b7502-6d07-4969-8e5a-6799f133a9c6. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] Acquiring lock "refresh_cache-1093381e-c322-4ed0-91cb-1a8e956f8dfd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] Acquired lock "refresh_cache-1093381e-c322-4ed0-91cb-1a8e956f8dfd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.network.neutron [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Refreshing network info cache for port 5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-f576abc5-02a0-4218-a3ec-c2bc5e420709 req-6960b09e-fe45-4518-b1a0-d75e07a9adf2 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f576abc5-02a0-4218-a3ec-c2bc5e420709 req-6960b09e-fe45-4518-b1a0-d75e07a9adf2 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f576abc5-02a0-4218-a3ec-c2bc5e420709 req-6960b09e-fe45-4518-b1a0-d75e07a9adf2 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f576abc5-02a0-4218-a3ec-c2bc5e420709 req-6960b09e-fe45-4518-b1a0-d75e07a9adf2 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-f576abc5-02a0-4218-a3ec-c2bc5e420709 req-6960b09e-fe45-4518-b1a0-d75e07a9adf2 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:39 user nova-compute[70869]: WARNING nova.compute.manager [req-f576abc5-02a0-4218-a3ec-c2bc5e420709 req-6960b09e-fe45-4518-b1a0-d75e07a9adf2 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc for instance with vm_state building and task_state spawning.
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299219.1090078, dd06411a-f6dc-4e4a-894f-517410bda71d => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:33:39 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] VM Resumed (Lifecycle Event)
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:33:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance spawned successfully.
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:39 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299219.109219, dd06411a-f6dc-4e4a-894f-517410bda71d => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:33:39 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] VM Started (Lifecycle Event)
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:33:39 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:33:39 user nova-compute[70869]: INFO nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Took 15.88 seconds to spawn the instance on the hypervisor.
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:39 user nova-compute[70869]: INFO nova.compute.manager [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Took 40.03 seconds to build instance.
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-03411251-5d8e-4972-be4f-bc66a3b6a244 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.134s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.network.neutron [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Updated VIF entry in instance network info cache for port 5e1b7502-6d07-4969-8e5a-6799f133a9c6. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.network.neutron [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Updating instance_info_cache with network_info: [{"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] Releasing lock "refresh_cache-1093381e-c322-4ed0-91cb-1a8e956f8dfd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:39 user nova-compute[70869]: WARNING nova.compute.manager [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 for instance with vm_state building and task_state spawning.
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:39 user nova-compute[70869]: WARNING nova.compute.manager [req-061f9481-cceb-4456-ad99-943f61e994c5 req-edd18670-e132-4afc-925a-f962386eb2b4 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 for instance with vm_state building and task_state spawning.
Jul 25 15:33:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:40 user nova-compute[70869]: WARNING nova.compute.manager [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 for instance with vm_state building and task_state spawning.
Jul 25 15:33:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:40 user nova-compute[70869]: WARNING nova.compute.manager [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e for instance with vm_state building and task_state spawning.
Jul 25 15:33:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:40 user nova-compute[70869]: WARNING nova.compute.manager [req-cad856cd-d62d-4e98-8584-f363165436bd req-32cb9306-135f-4b3a-947e-45f29eede05f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e for instance with vm_state building and task_state spawning.
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:41 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Snapshot image upload complete
Jul 25 15:33:41 user nova-compute[70869]: INFO nova.compute.manager [None req-1c013eab-833c-4c08-b339-9b8ee45404cb tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Took 6.10 seconds to snapshot the instance on the hypervisor.
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:41 user nova-compute[70869]: WARNING nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc for instance with vm_state building and task_state spawning.
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:41 user nova-compute[70869]: WARNING nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 for instance with vm_state building and task_state spawning.
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:41 user nova-compute[70869]: WARNING nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 for instance with vm_state building and task_state spawning.
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:41 user nova-compute[70869]: WARNING nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d for instance with vm_state building and task_state spawning.
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:41 user nova-compute[70869]: WARNING nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d for instance with vm_state building and task_state spawning.
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received event network-vif-plugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Acquiring lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] No waiting events found dispatching network-vif-plugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:41 user nova-compute[70869]: WARNING nova.compute.manager [req-6ca63ecb-f299-4da1-bd65-0c8f8a7a5c5b req-f26e2ea9-87ae-45aa-8b78-85458efa6910 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received unexpected event network-vif-plugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 for instance with vm_state building and task_state spawning.
Jul 25 15:33:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-292fff27-d41b-43f8-9be1-3364841cd074 req-1f3371a5-e2e4-4f3e-ad99-077623897f4c service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-changed-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-292fff27-d41b-43f8-9be1-3364841cd074 req-1f3371a5-e2e4-4f3e-ad99-077623897f4c service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Refreshing instance network info cache due to event network-changed-b512c720-cc12-4cbd-98b1-62b64bc2a752. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-292fff27-d41b-43f8-9be1-3364841cd074 req-1f3371a5-e2e4-4f3e-ad99-077623897f4c service nova] Acquiring lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-292fff27-d41b-43f8-9be1-3364841cd074 req-1f3371a5-e2e4-4f3e-ad99-077623897f4c service nova] Acquired lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:42 user nova-compute[70869]: DEBUG nova.network.neutron [req-292fff27-d41b-43f8-9be1-3364841cd074 req-1f3371a5-e2e4-4f3e-ad99-077623897f4c service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Refreshing network info cache for port b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:42 user nova-compute[70869]: INFO nova.compute.manager [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] instance snapshotting
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Beginning live snapshot process
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json -f qcow2 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-a14d353c-e8bd-4a48-bb6c-d445ec7810b0 req-c28e347f-d172-41a6-8d70-974e0e2a5688 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received event network-vif-plugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a14d353c-e8bd-4a48-bb6c-d445ec7810b0 req-c28e347f-d172-41a6-8d70-974e0e2a5688 service nova] Acquiring lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a14d353c-e8bd-4a48-bb6c-d445ec7810b0 req-c28e347f-d172-41a6-8d70-974e0e2a5688 service nova] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a14d353c-e8bd-4a48-bb6c-d445ec7810b0 req-c28e347f-d172-41a6-8d70-974e0e2a5688 service nova] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-a14d353c-e8bd-4a48-bb6c-d445ec7810b0 req-c28e347f-d172-41a6-8d70-974e0e2a5688 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] No waiting events found dispatching network-vif-plugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:43 user nova-compute[70869]: WARNING nova.compute.manager [req-a14d353c-e8bd-4a48-bb6c-d445ec7810b0 req-c28e347f-d172-41a6-8d70-974e0e2a5688 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received unexpected event network-vif-plugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 for instance with vm_state building and task_state spawning.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299223.2388473, 1093381e-c322-4ed0-91cb-1a8e956f8dfd => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] VM Resumed (Lifecycle Event)
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Instance spawned successfully.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299223.2435644, 1093381e-c322-4ed0-91cb-1a8e956f8dfd => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] VM Started (Lifecycle Event)
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json -f qcow2 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299223.3679683, da94f076-89f8-40be-b8bb-f4f8a73953ae => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] VM Resumed (Lifecycle Event)
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Took 8.33 seconds to spawn the instance on the hypervisor.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance spawned successfully.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299223.3686903, da94f076-89f8-40be-b8bb-f4f8a73953ae => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] VM Started (Lifecycle Event)
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json -f qcow2" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Took 9.90 seconds to build instance.
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Took 20.14 seconds to spawn the instance on the hypervisor.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2f6f411a-c610-4c08-b5b9-41ef9866241c tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.045s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphnc5d5ft/ccc4149a015e43edb1d91a2299e4f29f.delta 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-4dc64a06-9e1f-4628-bf66-86f8888cae1f req-00f80c96-3774-4a87-8476-80dc3f3616a3 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-changed-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-4dc64a06-9e1f-4628-bf66-86f8888cae1f req-00f80c96-3774-4a87-8476-80dc3f3616a3 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Refreshing instance network info cache due to event network-changed-b7d31348-a01c-40f7-993c-e350d788f767. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4dc64a06-9e1f-4628-bf66-86f8888cae1f req-00f80c96-3774-4a87-8476-80dc3f3616a3 service nova] Acquiring lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4dc64a06-9e1f-4628-bf66-86f8888cae1f req-00f80c96-3774-4a87-8476-80dc3f3616a3 service nova] Acquired lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-4dc64a06-9e1f-4628-bf66-86f8888cae1f req-00f80c96-3774-4a87-8476-80dc3f3616a3 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Refreshing network info cache for port b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-292fff27-d41b-43f8-9be1-3364841cd074 req-1f3371a5-e2e4-4f3e-ad99-077623897f4c service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Updated VIF entry in instance network info cache for port b512c720-cc12-4cbd-98b1-62b64bc2a752. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-292fff27-d41b-43f8-9be1-3364841cd074 req-1f3371a5-e2e4-4f3e-ad99-077623897f4c service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating instance_info_cache with network_info: [{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphnc5d5ft/ccc4149a015e43edb1d91a2299e4f29f.delta 1073741824" returned: 0 in 0.075s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 15:33:43 user nova-compute[70869]: INFO nova.compute.manager [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Took 42.45 seconds to build instance.
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-06f6cc5f-b95d-4f0d-84ee-1c9b896407df tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.548s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-292fff27-d41b-43f8-9be1-3364841cd074 req-1f3371a5-e2e4-4f3e-ad99-077623897f4c service nova] Releasing lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-4dc64a06-9e1f-4628-bf66-86f8888cae1f req-00f80c96-3774-4a87-8476-80dc3f3616a3 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updated VIF entry in instance network info cache for port b7d31348-a01c-40f7-993c-e350d788f767. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-4dc64a06-9e1f-4628-bf66-86f8888cae1f req-00f80c96-3774-4a87-8476-80dc3f3616a3 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating instance_info_cache with network_info: [{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4dc64a06-9e1f-4628-bf66-86f8888cae1f req-00f80c96-3774-4a87-8476-80dc3f3616a3 service nova] Releasing lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIRbZrqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:44 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:44 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:44 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ff458c-8e78-40ab-8d81-e6bf422ab08f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:33:44 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[00364f23-a3b3-49a9-8c3a-f31ac9a7a1b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b] added
Jul 25 15:33:44 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe63ba2-5274-43f9-af1d-c56e1f56a14b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d061dc81-bcbc-458c-a1fa-55794fb65027]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fIRbZrqX {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fIRbZrqX" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c70d1af-0179-407f-a318-75fe89a91401]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fIRbZrqX'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[176febe4-1d85-4fbc-94c8-e135059d9295]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c96f2-ad71-46ec-973b-b45c613db61a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8352f922-eb4a-40fe-896a-99e32adb5f41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b, portal: 172.16.0.220,3260]
Jul 25 15:33:45 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b, portal: 172.16.0.220,3260] successful.
Jul 25 15:33:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[70820ebf-8d80-469a-86e7-6ba1f126bcd3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:45 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[739045e8-5bd5-4838-b147-0ba7099e94a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b (non-flash)
Jul 25 15:33:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:33:45 user nova-compute[70869]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b (non-flash)
Jul 25 15:33:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd153b3e-f198-4b3f-b4e5-4e9d165cffc3]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIRbZrqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphnc5d5ft/ccc4149a015e43edb1d91a2299e4f29f.delta /opt/stack/data/nova/instances/snapshots/tmphnc5d5ft/ccc4149a015e43edb1d91a2299e4f29f {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-3dd77c6d-e1cb-4250-a8ce-78fbd2458d1c req-0b4ea17e-5f72-4916-b7ec-f778b457bbdd service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received event network-changed-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-3dd77c6d-e1cb-4250-a8ce-78fbd2458d1c req-0b4ea17e-5f72-4916-b7ec-f778b457bbdd service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Refreshing instance network info cache due to event network-changed-2606ef46-4806-4296-b081-1e354878db1f. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3dd77c6d-e1cb-4250-a8ce-78fbd2458d1c req-0b4ea17e-5f72-4916-b7ec-f778b457bbdd service nova] Acquiring lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3dd77c6d-e1cb-4250-a8ce-78fbd2458d1c req-0b4ea17e-5f72-4916-b7ec-f778b457bbdd service nova] Acquired lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-3dd77c6d-e1cb-4250-a8ce-78fbd2458d1c req-0b4ea17e-5f72-4916-b7ec-f778b457bbdd service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Refreshing network info cache for port 2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphnc5d5ft/ccc4149a015e43edb1d91a2299e4f29f.delta /opt/stack/data/nova/instances/snapshots/tmphnc5d5ft/ccc4149a015e43edb1d91a2299e4f29f" returned: 0 in 0.484s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:45 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Snapshot extracted, beginning image upload
Jul 25 15:33:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.505s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] <== connect_volume: return (1508ms) {'type': 'block', 'scsi_wwn': '23034396363363862', 'path': '/dev/sdh'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034396363363862', 'path': '/dev/sdh'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lazy-loading 'flavor' on Instance uuid bb1bf680-5ab7-4210-b3d1-44fe0775a9ca {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG nova.network.neutron [req-3dd77c6d-e1cb-4250-a8ce-78fbd2458d1c req-0b4ea17e-5f72-4916-b7ec-f778b457bbdd service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Updated VIF entry in instance network info cache for port 2606ef46-4806-4296-b081-1e354878db1f. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG nova.network.neutron [req-3dd77c6d-e1cb-4250-a8ce-78fbd2458d1c req-0b4ea17e-5f72-4916-b7ec-f778b457bbdd service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Updating instance_info_cache with network_info: [{"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3dd77c6d-e1cb-4250-a8ce-78fbd2458d1c req-0b4ea17e-5f72-4916-b7ec-f778b457bbdd service nova] Releasing lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:33:46 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:33:46 user nova-compute[70869]:   <source dev="/dev/sdh"/>
Jul 25 15:33:46 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:33:46 user nova-compute[70869]:   <serial>a57284f5-ed77-4f4a-ba30-f21180b3cb1b</serial>
Jul 25 15:33:46 user nova-compute[70869]: </disk>
Jul 25 15:33:46 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:33:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] No VIF found with MAC fa:16:3e:d7:31:d0, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:33:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e9e494a0-34fa-45c5-ac04-dd836294e4f5 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.278s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:48 user nova-compute[70869]: INFO nova.compute.manager [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Terminating instance
Jul 25 15:33:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:33:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Snapshot image upload complete
Jul 25 15:33:49 user nova-compute[70869]: INFO nova.compute.manager [None req-477de5fb-0e19-4156-b677-61c4ba19b0cb tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Took 6.07 seconds to snapshot the instance on the hypervisor.
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-d7b6b4be-9007-4d86-8597-ee0505fd0cc7 req-6b62efc0-fc7e-4b6b-ae8e-8cc22166cf4c service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received event network-vif-unplugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d7b6b4be-9007-4d86-8597-ee0505fd0cc7 req-6b62efc0-fc7e-4b6b-ae8e-8cc22166cf4c service nova] Acquiring lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d7b6b4be-9007-4d86-8597-ee0505fd0cc7 req-6b62efc0-fc7e-4b6b-ae8e-8cc22166cf4c service nova] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d7b6b4be-9007-4d86-8597-ee0505fd0cc7 req-6b62efc0-fc7e-4b6b-ae8e-8cc22166cf4c service nova] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-d7b6b4be-9007-4d86-8597-ee0505fd0cc7 req-6b62efc0-fc7e-4b6b-ae8e-8cc22166cf4c service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] No waiting events found dispatching network-vif-unplugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-d7b6b4be-9007-4d86-8597-ee0505fd0cc7 req-6b62efc0-fc7e-4b6b-ae8e-8cc22166cf4c service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received event network-vif-unplugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Instance destroyed successfully.
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lazy-loading 'resources' on Instance uuid bb1bf680-5ab7-4210-b3d1-44fe0775a9ca {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-466458426',display_name='tempest-DeleteServersTestJSON-server-466458426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-466458426',id=1,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:31:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='608fa31dcdc54e219968ddf70245eb4e',ramdisk_id='',reservation_id='r-inj6krl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1412196701',owner_user_name='tempest-DeleteServersTestJSON-1412196701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:31:59Z,user_data=None,user_id='6d70372142da4c54a79ce2b0082ac8cc',uuid=bb1bf680-5ab7-4210-b3d1-44fe0775a9ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Converting VIF {"id": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "address": "fa:16:3e:d7:31:d0", "network": {"id": "b9590cf0-eeff-45f6-bb79-743833a7a38d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-709725425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608fa31dcdc54e219968ddf70245eb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77aff25d-6e", "ovs_interfaceid": "77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:31:d0,bridge_name='br-int',has_traffic_filtering=True,id=77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf,network=Network(b9590cf0-eeff-45f6-bb79-743833a7a38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77aff25d-6e') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_vif [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:31:d0,bridge_name='br-int',has_traffic_filtering=True,id=77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf,network=Network(b9590cf0-eeff-45f6-bb79-743833a7a38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77aff25d-6e') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77aff25d-6e, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:33:49 user nova-compute[70869]: INFO os_vif [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:31:d0,bridge_name='br-int',has_traffic_filtering=True,id=77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf,network=Network(b9590cf0-eeff-45f6-bb79-743833a7a38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77aff25d-6e')
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fIRbZrqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:49 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0f2732-12fb-43fa-882f-397d6673f3d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:33:49 user nova-compute[70869]: No targets found.
Jul 25 15:33:49 user nova-compute[70869]: iSNS:
Jul 25 15:33:49 user nova-compute[70869]: No targets found.
Jul 25 15:33:49 user nova-compute[70869]: STATIC:
Jul 25 15:33:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b
Jul 25 15:33:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:33:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:33:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:33:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:33:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:33:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:33:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:33:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:33:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:33:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:33:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:33:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:33:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:33:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:33:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491
Jul 25 15:33:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:33:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:33:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a
Jul 25 15:33:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:33:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:33:49 user nova-compute[70869]: FIRMWARE:
Jul 25 15:33:49 user nova-compute[70869]: No targets found.
Jul 25 15:33:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:33:49 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:33:49 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.075s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6c1564-001c-40f5-9b85-69611a387914]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c51a70-993d-40f7-8b1e-4811a1b23e5e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b (non-flash)
Jul 25 15:33:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:33:49 user nova-compute[70869]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b (non-flash)
Jul 25 15:33:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43432d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b'): ({'sdh'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Removing single pathed devices sdh {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f0c49-f6bd-4df8-a551-4a8513990133]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5790449-5052-44ff-a1f9-09d155117f9d]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Flushing IO for device /dev/sdh {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7e99ed-fda8-4d70-b3f0-7430f6105c20]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a1bee5-ab46-4847-ae2c-548baae9661c]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] SCSI volumes sdh have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa04c19-e807-4e67-8007-ac2573330fde]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c2e8f-013c-49f2-b2d1-dd3fb7e6f306]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b, portal: 172.16.0.220,3260]
Jul 25 15:33:49 user nova-compute[70869]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b, portal: 172.16.0.220,3260] successful.
Jul 25 15:33:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57284f5-ed77-4f4a-ba30-f21180b3cb1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a11efc5-b027-476c-aa9c-f1d58a5c6b9d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] <== disconnect_volume: return (459ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:33:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Deleting instance files /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca_del
Jul 25 15:33:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Deletion of /opt/stack/data/nova/instances/bb1bf680-5ab7-4210-b3d1-44fe0775a9ca_del complete
Jul 25 15:33:49 user nova-compute[70869]: INFO nova.compute.manager [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Took 1.52 seconds to destroy the instance on the hypervisor.
Jul 25 15:33:49 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:50 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:50 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Took 0.87 seconds to deallocate network for instance.
Jul 25 15:33:50 user nova-compute[70869]: DEBUG nova.compute.manager [req-8f96860a-56d4-4333-a959-08029bcdf079 req-c3811c21-2e62-43fd-ab8e-eca6e1ffabab service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received event network-vif-deleted-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-cbab0304-c2d7-43d6-bded-8d8d0c263e2c req-5785e8f5-44fe-4a3e-9cc4-b6a151d819d1 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received event network-vif-plugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cbab0304-c2d7-43d6-bded-8d8d0c263e2c req-5785e8f5-44fe-4a3e-9cc4-b6a151d819d1 service nova] Acquiring lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cbab0304-c2d7-43d6-bded-8d8d0c263e2c req-5785e8f5-44fe-4a3e-9cc4-b6a151d819d1 service nova] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cbab0304-c2d7-43d6-bded-8d8d0c263e2c req-5785e8f5-44fe-4a3e-9cc4-b6a151d819d1 service nova] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-cbab0304-c2d7-43d6-bded-8d8d0c263e2c req-5785e8f5-44fe-4a3e-9cc4-b6a151d819d1 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] No waiting events found dispatching network-vif-plugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:33:51 user nova-compute[70869]: WARNING nova.compute.manager [req-cbab0304-c2d7-43d6-bded-8d8d0c263e2c req-5785e8f5-44fe-4a3e-9cc4-b6a151d819d1 service nova] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Received unexpected event network-vif-plugged-77aff25d-6ef4-4ef4-837b-6eb1e9cf22bf for instance with vm_state active and task_state deleting.
Jul 25 15:33:51 user nova-compute[70869]: INFO nova.compute.manager [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Took 0.87 seconds to detach 1 volumes for instance.
Jul 25 15:33:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:52 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:33:52 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:33:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:52 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Deleted allocations for instance bb1bf680-5ab7-4210-b3d1-44fe0775a9ca
Jul 25 15:33:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f7bd674d-f91d-4603-98b9-1ab50f113aa7 tempest-DeleteServersTestJSON-1412196701 tempest-DeleteServersTestJSON-1412196701-project-member] Lock "bb1bf680-5ab7-4210-b3d1-44fe0775a9ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.980s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:33:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:33:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:33:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:33:53 user nova-compute[70869]: INFO nova.compute.claims [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Claim successful on node user
Jul 25 15:33:54 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG nova.network.neutron [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:33:54 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:33:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:33:54 user nova-compute[70869]: INFO nova.virt.block_device [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Booting with volume 1fab0f90-3418-4b93-b8dd-d2bd164db283 at /dev/vda
Jul 25 15:33:54 user nova-compute[70869]: DEBUG nova.policy [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0d6af7f176145f382a7cc839ed2c027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d4e6ad84894e2d8ca5aee1aa77db4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG os_brick.utils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd078f-3700-4f2b-b5fe-87a35a85d877]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73ee46d-6e80-41e4-abd6-0f3a111052c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b0dea0-c916-4288-b1ac-f9b8382a24c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b431af-0fed-440f-9c40-2c2f3cd9e143]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:33:54 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:33:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d7d964-12f2-41b6-8108-b15cd396010e]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG os_brick.utils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Updating existing volume attachment record: 344972be-2001-49b7-914c-f021e1779393 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:33:54 user nova-compute[70869]: DEBUG nova.network.neutron [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Successfully created port: 7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:33:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Successfully updated port: 7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:33:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "refresh_cache-3b38a39b-5ad8-4341-b132-597b8ab6a849" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquired lock "refresh_cache-3b38a39b-5ad8-4341-b132-597b8ab6a849" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:33:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-e66bdf53-c774-426f-8572-b4d85e4ceddc req-dbf24d11-de77-44ee-97b4-88aea0cc8cfb service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-changed-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:33:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-e66bdf53-c774-426f-8572-b4d85e4ceddc req-dbf24d11-de77-44ee-97b4-88aea0cc8cfb service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Refreshing instance network info cache due to event network-changed-7bde5f26-2d7a-4e3e-adff-311873ad7a87. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:33:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e66bdf53-c774-426f-8572-b4d85e4ceddc req-dbf24d11-de77-44ee-97b4-88aea0cc8cfb service nova] Acquiring lock "refresh_cache-3b38a39b-5ad8-4341-b132-597b8ab6a849" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:33:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:33:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Updating instance_info_cache with network_info: [{"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Releasing lock "refresh_cache-3b38a39b-5ad8-4341-b132-597b8ab6a849" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:56 user nova-compute[70869]: DEBUG nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance network_info: |[{"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:33:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e66bdf53-c774-426f-8572-b4d85e4ceddc req-dbf24d11-de77-44ee-97b4-88aea0cc8cfb service nova] Acquired lock "refresh_cache-3b38a39b-5ad8-4341-b132-597b8ab6a849" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:33:56 user nova-compute[70869]: DEBUG nova.network.neutron [req-e66bdf53-c774-426f-8572-b4d85e4ceddc req-dbf24d11-de77-44ee-97b4-88aea0cc8cfb service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Refreshing network info cache for port 7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:33:56 user nova-compute[70869]: DEBUG nova.network.neutron [req-e66bdf53-c774-426f-8572-b4d85e4ceddc req-dbf24d11-de77-44ee-97b4-88aea0cc8cfb service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Updated VIF entry in instance network info cache for port 7bde5f26-2d7a-4e3e-adff-311873ad7a87. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:33:56 user nova-compute[70869]: DEBUG nova.network.neutron [req-e66bdf53-c774-426f-8572-b4d85e4ceddc req-dbf24d11-de77-44ee-97b4-88aea0cc8cfb service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Updating instance_info_cache with network_info: [{"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:33:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e66bdf53-c774-426f-8572-b4d85e4ceddc req-dbf24d11-de77-44ee-97b4-88aea0cc8cfb service nova] Releasing lock "refresh_cache-3b38a39b-5ad8-4341-b132-597b8ab6a849" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:33:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:33:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:34:02 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Creating image(s)
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Ensure instance console log exists: /opt/stack/data/nova/instances/3b38a39b-5ad8-4341-b132-597b8ab6a849/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Start _get_guest_xml network_info=[{"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '344972be-2001-49b7-914c-f021e1779393', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awASrUZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b38a39b-5ad8-4341-b132-597b8ab6a849', 'attached_at': '', 'detached_at': '', 'volume_id': '1fab0f90-3418-4b93-b8dd-d2bd164db283', 'serial': '1fab0f90-3418-4b93-b8dd-d2bd164db283'}, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:34:02 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:34:02 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awASrUZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:02 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:02 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:02 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-889e46d0-bae0-484c-98ac-c1bf93cfc8cb req-fedfa514-f845-4090-9517-013887a55daa service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-changed-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-889e46d0-bae0-484c-98ac-c1bf93cfc8cb req-fedfa514-f845-4090-9517-013887a55daa service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Refreshing instance network info cache due to event network-changed-90ce04e4-d390-4067-8a50-755e4964ab52. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-889e46d0-bae0-484c-98ac-c1bf93cfc8cb req-fedfa514-f845-4090-9517-013887a55daa service nova] Acquiring lock "refresh_cache-08fa2836-717a-4893-8969-fcab677935a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-889e46d0-bae0-484c-98ac-c1bf93cfc8cb req-fedfa514-f845-4090-9517-013887a55daa service nova] Acquired lock "refresh_cache-08fa2836-717a-4893-8969-fcab677935a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-889e46d0-bae0-484c-98ac-c1bf93cfc8cb req-fedfa514-f845-4090-9517-013887a55daa service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Refreshing network info cache for port 90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c1ed7a-8828-4132-8c3e-3f18bccdd1c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:34:02 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86d5f14-90ac-4452-bcd6-472818cac287]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283] added
Jul 25 15:34:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaff9f2-3008-4394-a19c-f860ad3f804e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[507ddfec-e2aa-4d6f-8304-e8a3369b395b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awASrUZC {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awASrUZC" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7484f182-edcc-44d5-a1d8-834467609b80]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awASrUZC'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[662862bc-bafe-43a6-a200-c89f104aa266]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceaa4b9-0dec-4c2e-a163-557c44dd5f3b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70e79a8-7358-48f4-b836-90e551dfe7d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260]
Jul 25 15:34:02 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90a062a-b9d2-4d9a-b254-e523f58cc758]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac44935-91ba-4ef2-a56a-39363d719982]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ced1fb-c570-4d48-9c16-5fbd10d893bd]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-889e46d0-bae0-484c-98ac-c1bf93cfc8cb req-fedfa514-f845-4090-9517-013887a55daa service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Updated VIF entry in instance network info cache for port 90ce04e4-d390-4067-8a50-755e4964ab52. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-889e46d0-bae0-484c-98ac-c1bf93cfc8cb req-fedfa514-f845-4090-9517-013887a55daa service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Updating instance_info_cache with network_info: [{"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-889e46d0-bae0-484c-98ac-c1bf93cfc8cb req-fedfa514-f845-4090-9517-013887a55daa service nova] Releasing lock "refresh_cache-08fa2836-717a-4893-8969-fcab677935a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:03 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:34:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awASrUZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:34:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26164376234373239', 'path': '/dev/sdh'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:03 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164376234373239', 'path': '/dev/sdh'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-805847803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-805847803',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkVAmxmlz9/k5ZXxC76vtVdp+U7q5KzaQBmndoNBkWoKxXxqljSS1jb5uYAjGuvcLIZ8lDA73m2VNNzORpITL5U/MKWIHqpe2k7cYW8WX1atjyqJ4EsYC2Jah+XtUpLw==',key_name='tempest-keypair-1784292135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27d4e6ad84894e2d8ca5aee1aa77db4e',ramdisk_id='',reservation_id='r-0fnuttbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1601506810',owner_user_name='tempest-ServerActionsV293TestJSON-1601506810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0d6af7f176145f382a7cc839ed2c027',uuid=3b38a39b-5ad8-4341-b132-597b8ab6a849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converting VIF {"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.objects.instance [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b38a39b-5ad8-4341-b132-597b8ab6a849 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:34:04 user nova-compute[70869]:   <uuid>3b38a39b-5ad8-4341-b132-597b8ab6a849</uuid>
Jul 25 15:34:04 user nova-compute[70869]:   <name>instance-0000000e</name>
Jul 25 15:34:04 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:34:04 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:34:04 user nova-compute[70869]:   <metadata>
Jul 25 15:34:04 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:34:04 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:34:04 user nova-compute[70869]:       <nova:name>tempest-ServerActionsV293TestJSON-server-805847803</nova:name>
Jul 25 15:34:04 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:34:02</nova:creationTime>
Jul 25 15:34:04 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:34:04 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:34:04 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:34:04 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:34:04 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:34:04 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:34:04 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:34:04 user nova-compute[70869]:       <nova:owner>
Jul 25 15:34:04 user nova-compute[70869]:         <nova:user uuid="d0d6af7f176145f382a7cc839ed2c027">tempest-ServerActionsV293TestJSON-1601506810-project-member</nova:user>
Jul 25 15:34:04 user nova-compute[70869]:         <nova:project uuid="27d4e6ad84894e2d8ca5aee1aa77db4e">tempest-ServerActionsV293TestJSON-1601506810</nova:project>
Jul 25 15:34:04 user nova-compute[70869]:       </nova:owner>
Jul 25 15:34:04 user nova-compute[70869]:       <nova:ports>
Jul 25 15:34:04 user nova-compute[70869]:         <nova:port uuid="7bde5f26-2d7a-4e3e-adff-311873ad7a87">
Jul 25 15:34:04 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 15:34:04 user nova-compute[70869]:         </nova:port>
Jul 25 15:34:04 user nova-compute[70869]:       </nova:ports>
Jul 25 15:34:04 user nova-compute[70869]:     </nova:instance>
Jul 25 15:34:04 user nova-compute[70869]:   </metadata>
Jul 25 15:34:04 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:34:04 user nova-compute[70869]:     <system>
Jul 25 15:34:04 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:34:04 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:34:04 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:34:04 user nova-compute[70869]:       <entry name="serial">3b38a39b-5ad8-4341-b132-597b8ab6a849</entry>
Jul 25 15:34:04 user nova-compute[70869]:       <entry name="uuid">3b38a39b-5ad8-4341-b132-597b8ab6a849</entry>
Jul 25 15:34:04 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:34:04 user nova-compute[70869]:     </system>
Jul 25 15:34:04 user nova-compute[70869]:   </sysinfo>
Jul 25 15:34:04 user nova-compute[70869]:   <os>
Jul 25 15:34:04 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:34:04 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:34:04 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:34:04 user nova-compute[70869]:   </os>
Jul 25 15:34:04 user nova-compute[70869]:   <features>
Jul 25 15:34:04 user nova-compute[70869]:     <acpi/>
Jul 25 15:34:04 user nova-compute[70869]:     <apic/>
Jul 25 15:34:04 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:34:04 user nova-compute[70869]:   </features>
Jul 25 15:34:04 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:34:04 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:34:04 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:34:04 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:34:04 user nova-compute[70869]:   </clock>
Jul 25 15:34:04 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:34:04 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:34:04 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:34:04 user nova-compute[70869]:   </cpu>
Jul 25 15:34:04 user nova-compute[70869]:   <devices>
Jul 25 15:34:04 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:34:04 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:04 user nova-compute[70869]:       <source dev="/dev/sdh"/>
Jul 25 15:34:04 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:34:04 user nova-compute[70869]:       <serial>1fab0f90-3418-4b93-b8dd-d2bd164db283</serial>
Jul 25 15:34:04 user nova-compute[70869]:     </disk>
Jul 25 15:34:04 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:34:04 user nova-compute[70869]:       <mac address="fa:16:3e:08:25:0f"/>
Jul 25 15:34:04 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:34:04 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:34:04 user nova-compute[70869]:       <target dev="tap7bde5f26-2d"/>
Jul 25 15:34:04 user nova-compute[70869]:     </interface>
Jul 25 15:34:04 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:34:04 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/3b38a39b-5ad8-4341-b132-597b8ab6a849/console.log" append="off"/>
Jul 25 15:34:04 user nova-compute[70869]:     </serial>
Jul 25 15:34:04 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:34:04 user nova-compute[70869]:     <video>
Jul 25 15:34:04 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:34:04 user nova-compute[70869]:     </video>
Jul 25 15:34:04 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:34:04 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:34:04 user nova-compute[70869]:     </rng>
Jul 25 15:34:04 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:34:04 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:34:04 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:34:04 user nova-compute[70869]:     </memballoon>
Jul 25 15:34:04 user nova-compute[70869]:   </devices>
Jul 25 15:34:04 user nova-compute[70869]: </domain>
Jul 25 15:34:04 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-805847803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-805847803',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkVAmxmlz9/k5ZXxC76vtVdp+U7q5KzaQBmndoNBkWoKxXxqljSS1jb5uYAjGuvcLIZ8lDA73m2VNNzORpITL5U/MKWIHqpe2k7cYW8WX1atjyqJ4EsYC2Jah+XtUpLw==',key_name='tempest-keypair-1784292135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27d4e6ad84894e2d8ca5aee1aa77db4e',ramdisk_id='',reservation_id='r-0fnuttbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1601506810',owner_user_name='tempest-ServerActionsV293TestJSON-1601506810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0d6af7f176145f382a7cc839ed2c027',uuid=3b38a39b-5ad8-4341-b132-597b8ab6a849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converting VIF {"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG os_vif [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bde5f26-2d, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7bde5f26-2d, col_values=(('external_ids', {'iface-id': '7bde5f26-2d7a-4e3e-adff-311873ad7a87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:25:0f', 'vm-uuid': '3b38a39b-5ad8-4341-b132-597b8ab6a849'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299229.1040316, bb1bf680-5ab7-4210-b3d1-44fe0775a9ca => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:34:04 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] VM Stopped (Lifecycle Event)
Jul 25 15:34:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:04 user nova-compute[70869]: INFO os_vif [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d')
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4e2d572-98d7-489e-ba32-aee22d44c8ad None None] [instance: bb1bf680-5ab7-4210-b3d1-44fe0775a9ca] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] No VIF found with MAC fa:16:3e:08:25:0f, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-b3b580a8-9e0d-49c7-927f-7d4a3765bd68 req-e993d2c5-5c79-4706-950e-6324cf1a3b61 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3b580a8-9e0d-49c7-927f-7d4a3765bd68 req-e993d2c5-5c79-4706-950e-6324cf1a3b61 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3b580a8-9e0d-49c7-927f-7d4a3765bd68 req-e993d2c5-5c79-4706-950e-6324cf1a3b61 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3b580a8-9e0d-49c7-927f-7d4a3765bd68 req-e993d2c5-5c79-4706-950e-6324cf1a3b61 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-b3b580a8-9e0d-49c7-927f-7d4a3765bd68 req-e993d2c5-5c79-4706-950e-6324cf1a3b61 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No waiting events found dispatching network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:05 user nova-compute[70869]: WARNING nova.compute.manager [req-b3b580a8-9e0d-49c7-927f-7d4a3765bd68 req-e993d2c5-5c79-4706-950e-6324cf1a3b61 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state building and task_state spawning.
Jul 25 15:34:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lazy-loading 'flavor' on Instance uuid 08fa2836-717a-4893-8969-fcab677935a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:06 user nova-compute[70869]: INFO nova.compute.manager [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Attaching volume be1586aa-0ce7-42d1-82e0-dce218f21159 to /dev/vdb
Jul 25 15:34:06 user nova-compute[70869]: DEBUG os_brick.utils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[049eca68-53b0-48b3-87e5-bde973d119bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feb01ab-ad69-47b6-90a6-1f9dd088b842]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c800c98-a976-41da-aaff-107893f08852]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f28968b-b413-4cb7-83eb-3e95a089900e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:06 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:34:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cdff8c-68b1-47d3-b528-0a5d4ceee915]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG os_brick.utils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:06 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Updating existing volume attachment record: e2422e8f-4478-4b32-bcc6-b7c4bdc4d64c {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299247.749545, 3b38a39b-5ad8-4341-b132-597b8ab6a849 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:34:07 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] VM Resumed (Lifecycle Event)
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:34:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance spawned successfully.
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:34:07 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299247.7522836, 3b38a39b-5ad8-4341-b132-597b8ab6a849 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:34:07 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] VM Started (Lifecycle Event)
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-6a65ca35-a0c8-490b-b70c-cc58d935598f req-dbfd3323-0b6b-4718-9743-c67b07e2d2b0 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6a65ca35-a0c8-490b-b70c-cc58d935598f req-dbfd3323-0b6b-4718-9743-c67b07e2d2b0 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6a65ca35-a0c8-490b-b70c-cc58d935598f req-dbfd3323-0b6b-4718-9743-c67b07e2d2b0 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6a65ca35-a0c8-490b-b70c-cc58d935598f req-dbfd3323-0b6b-4718-9743-c67b07e2d2b0 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-6a65ca35-a0c8-490b-b70c-cc58d935598f req-dbfd3323-0b6b-4718-9743-c67b07e2d2b0 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No waiting events found dispatching network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:07 user nova-compute[70869]: WARNING nova.compute.manager [req-6a65ca35-a0c8-490b-b70c-cc58d935598f req-dbfd3323-0b6b-4718-9743-c67b07e2d2b0 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state building and task_state spawning.
Jul 25 15:34:07 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:34:07 user nova-compute[70869]: INFO nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Took 5.55 seconds to spawn the instance on the hypervisor.
Jul 25 15:34:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:34:07 user nova-compute[70869]: INFO nova.compute.manager [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Took 14.39 seconds to build instance.
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-27bc5fc6-4e41-416f-8013-37276eb4270e tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.485s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lazy-loading 'flavor' on Instance uuid 3a84f092-352e-4039-8dcb-bd4578458765 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:08 user nova-compute[70869]: INFO nova.compute.manager [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Attaching volume e4415034-90d6-4b57-b797-d80bb15563bd to /dev/vdb
Jul 25 15:34:08 user nova-compute[70869]: DEBUG os_brick.utils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[723176a6-58d7-47c0-9258-2a3d7731c231]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[306a9563-2e09-47d0-9736-cc97e83b5e81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[057faf14-f7a0-410a-958c-919c1a353b2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acd7fb5-38cf-4adb-a848-a24aba279024]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:08 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:34:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf73abe-3bb8-4f50-b604-dd738e640be9]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG os_brick.utils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:08 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Updating existing volume attachment record: acc9beea-fa1d-43a5-9bb3-366e79e61e8b {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:34:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-9e0278f2-2105-4914-8e34-a56c7d0c19f2 req-dd2e293c-7c9d-4d3a-af67-660fe2a4213c service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received event network-changed-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-9e0278f2-2105-4914-8e34-a56c7d0c19f2 req-dd2e293c-7c9d-4d3a-af67-660fe2a4213c service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Refreshing instance network info cache due to event network-changed-52bceafd-7e96-4a5e-b6b8-b834538e8f19. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:34:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9e0278f2-2105-4914-8e34-a56c7d0c19f2 req-dd2e293c-7c9d-4d3a-af67-660fe2a4213c service nova] Acquiring lock "refresh_cache-3a84f092-352e-4039-8dcb-bd4578458765" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9e0278f2-2105-4914-8e34-a56c7d0c19f2 req-dd2e293c-7c9d-4d3a-af67-660fe2a4213c service nova] Acquired lock "refresh_cache-3a84f092-352e-4039-8dcb-bd4578458765" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-9e0278f2-2105-4914-8e34-a56c7d0c19f2 req-dd2e293c-7c9d-4d3a-af67-660fe2a4213c service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Refreshing network info cache for port 52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:34:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-9e0278f2-2105-4914-8e34-a56c7d0c19f2 req-dd2e293c-7c9d-4d3a-af67-660fe2a4213c service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Updated VIF entry in instance network info cache for port 52bceafd-7e96-4a5e-b6b8-b834538e8f19. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:34:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-9e0278f2-2105-4914-8e34-a56c7d0c19f2 req-dd2e293c-7c9d-4d3a-af67-660fe2a4213c service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Updating instance_info_cache with network_info: [{"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9e0278f2-2105-4914-8e34-a56c7d0c19f2 req-dd2e293c-7c9d-4d3a-af67-660fe2a4213c service nova] Releasing lock "refresh_cache-3a84f092-352e-4039-8dcb-bd4578458765" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-2e8584c9-c830-4470-b426-d20790c1be80 req-3f5e7d7a-dd43-4cc1-bfb7-090f2061ac86 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-changed-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-2e8584c9-c830-4470-b426-d20790c1be80 req-3f5e7d7a-dd43-4cc1-bfb7-090f2061ac86 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Refreshing instance network info cache due to event network-changed-9911ada1-3a21-4e33-be13-d786a18560fd. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2e8584c9-c830-4470-b426-d20790c1be80 req-3f5e7d7a-dd43-4cc1-bfb7-090f2061ac86 service nova] Acquiring lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2e8584c9-c830-4470-b426-d20790c1be80 req-3f5e7d7a-dd43-4cc1-bfb7-090f2061ac86 service nova] Acquired lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG nova.network.neutron [req-2e8584c9-c830-4470-b426-d20790c1be80 req-3f5e7d7a-dd43-4cc1-bfb7-090f2061ac86 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Refreshing network info cache for port 9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-61d5e319-0dd3-4a62-808e-5a5cc660ec22 req-2197c7bc-bf09-4014-ae59-0685d4fd6ceb service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received event network-changed-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-61d5e319-0dd3-4a62-808e-5a5cc660ec22 req-2197c7bc-bf09-4014-ae59-0685d4fd6ceb service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Refreshing instance network info cache due to event network-changed-99306340-f2ac-483c-99d4-bf4a0fd05c25. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-61d5e319-0dd3-4a62-808e-5a5cc660ec22 req-2197c7bc-bf09-4014-ae59-0685d4fd6ceb service nova] Acquiring lock "refresh_cache-3927367a-ad7c-4ad7-9812-4b0199e9a9a1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-61d5e319-0dd3-4a62-808e-5a5cc660ec22 req-2197c7bc-bf09-4014-ae59-0685d4fd6ceb service nova] Acquired lock "refresh_cache-3927367a-ad7c-4ad7-9812-4b0199e9a9a1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG nova.network.neutron [req-61d5e319-0dd3-4a62-808e-5a5cc660ec22 req-2197c7bc-bf09-4014-ae59-0685d4fd6ceb service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Refreshing network info cache for port 99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "interface-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "interface-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:11 user nova-compute[70869]: DEBUG nova.objects.instance [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lazy-loading 'flavor' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lazy-loading 'pci_requests' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-2e8584c9-c830-4470-b426-d20790c1be80 req-3f5e7d7a-dd43-4cc1-bfb7-090f2061ac86 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updated VIF entry in instance network info cache for port 9911ada1-3a21-4e33-be13-d786a18560fd. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-2e8584c9-c830-4470-b426-d20790c1be80 req-3f5e7d7a-dd43-4cc1-bfb7-090f2061ac86 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updating instance_info_cache with network_info: [{"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2e8584c9-c830-4470-b426-d20790c1be80 req-3f5e7d7a-dd43-4cc1-bfb7-090f2061ac86 service nova] Releasing lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG nova.policy [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f21c066cfdbd498a9ac779e762799d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5e728d1bdf4015b917d1d77e7a2e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-61d5e319-0dd3-4a62-808e-5a5cc660ec22 req-2197c7bc-bf09-4014-ae59-0685d4fd6ceb service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Updated VIF entry in instance network info cache for port 99306340-f2ac-483c-99d4-bf4a0fd05c25. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-61d5e319-0dd3-4a62-808e-5a5cc660ec22 req-2197c7bc-bf09-4014-ae59-0685d4fd6ceb service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Updating instance_info_cache with network_info: [{"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-61d5e319-0dd3-4a62-808e-5a5cc660ec22 req-2197c7bc-bf09-4014-ae59-0685d4fd6ceb service nova] Releasing lock "refresh_cache-3927367a-ad7c-4ad7-9812-4b0199e9a9a1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Successfully created port: e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:34:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Successfully updated port: e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:34:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquired lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:34:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e23bca1-9639-454f-95e2-f0bcd9be394e req-9256fbe6-0489-4ec1-9507-6136d105c734 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-changed-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e23bca1-9639-454f-95e2-f0bcd9be394e req-9256fbe6-0489-4ec1-9507-6136d105c734 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Refreshing instance network info cache due to event network-changed-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:34:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e23bca1-9639-454f-95e2-f0bcd9be394e req-9256fbe6-0489-4ec1-9507-6136d105c734 service nova] Acquiring lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.network.neutron [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updating instance_info_cache with network_info: [{"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Releasing lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e23bca1-9639-454f-95e2-f0bcd9be394e req-9256fbe6-0489-4ec1-9507-6136d105c734 service nova] Acquired lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.network.neutron [req-0e23bca1-9639-454f-95e2-f0bcd9be394e req-9256fbe6-0489-4ec1-9507-6136d105c734 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Refreshing network info cache for port e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881880919',id=9,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCnjUFS4GVvp1uY+i4MWSiPTipwFlk1fAmhL09GyrCSrjDVSQvYyS8MW2Ahfcl4CTdExtioOorFgZMog5w/XI0cedHfxpHuJtENl/M1IXTFU2CPc7Y1H/+dLskGA8s5g==',key_name='tempest-keypair-1573765752',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e5e728d1bdf4015b917d1d77e7a2e75',ramdisk_id='',reservation_id='r-enxwzktb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1524187401',owner_user_name='tempest-TaggedAttachmentsTest-1524187401-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21c066cfdbd498a9ac779e762799d2b',uuid=b6c9b6d1-5006-4160-a559-ea5c46e7c4ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converting VIF {"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_vif [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2a9ec6f-08, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2a9ec6f-08, col_values=(('external_ids', {'iface-id': 'e2a9ec6f-08ed-4116-b0e2-c39099b07f7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:1c:6b', 'vm-uuid': 'b6c9b6d1-5006-4160-a559-ea5c46e7c4ff'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:14 user nova-compute[70869]: INFO os_vif [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08')
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881880919',id=9,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCnjUFS4GVvp1uY+i4MWSiPTipwFlk1fAmhL09GyrCSrjDVSQvYyS8MW2Ahfcl4CTdExtioOorFgZMog5w/XI0cedHfxpHuJtENl/M1IXTFU2CPc7Y1H/+dLskGA8s5g==',key_name='tempest-keypair-1573765752',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e5e728d1bdf4015b917d1d77e7a2e75',ramdisk_id='',reservation_id='r-enxwzktb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1524187401',owner_user_name='tempest-TaggedAttachmentsTest-1524187401-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21c066cfdbd498a9ac779e762799d2b',uuid=b6c9b6d1-5006-4160-a559-ea5c46e7c4ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converting VIF {"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] attach device xml: <interface type="ethernet">
Jul 25 15:34:14 user nova-compute[70869]:   <mac address="fa:16:3e:72:1c:6b"/>
Jul 25 15:34:14 user nova-compute[70869]:   <model type="virtio"/>
Jul 25 15:34:14 user nova-compute[70869]:   <mtu size="1442"/>
Jul 25 15:34:14 user nova-compute[70869]:   <target dev="tape2a9ec6f-08"/>
Jul 25 15:34:14 user nova-compute[70869]: </interface>
Jul 25 15:34:14 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTrVakim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:14 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:14 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:14 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02feadd-93f4-4ed7-8e89-38d7a6164d52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:34:14 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3997f562-7ab8-4402-8d0f-a9ed5834a580]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159] added
Jul 25 15:34:14 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0c2baf-3068-46cc-a19d-d4074d452c18]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.099s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd6d26-9e08-4573-a13a-2b23fb8f2f24]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTrVakim {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTrVakim" returned: 0 in 0.071s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c333d0fd-0309-4c4c-ae59-4bcfcc7c33f3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CTrVakim'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[942fbaf1-32e9-46cf-b3ca-e1a333d0aba1]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-55edb5ba-b6d5-4f25-8690-f2f30f262296 req-98a5ab7a-c6aa-4398-8867-2aa3c382f5bc service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-plugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-55edb5ba-b6d5-4f25-8690-f2f30f262296 req-98a5ab7a-c6aa-4398-8867-2aa3c382f5bc service nova] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-55edb5ba-b6d5-4f25-8690-f2f30f262296 req-98a5ab7a-c6aa-4398-8867-2aa3c382f5bc service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-55edb5ba-b6d5-4f25-8690-f2f30f262296 req-98a5ab7a-c6aa-4398-8867-2aa3c382f5bc service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-55edb5ba-b6d5-4f25-8690-f2f30f262296 req-98a5ab7a-c6aa-4398-8867-2aa3c382f5bc service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] No waiting events found dispatching network-vif-plugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:15 user nova-compute[70869]: WARNING nova.compute.manager [req-55edb5ba-b6d5-4f25-8690-f2f30f262296 req-98a5ab7a-c6aa-4398-8867-2aa3c382f5bc service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received unexpected event network-vif-plugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b for instance with vm_state active and task_state None.
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ff73ac-17c4-4bd9-972f-73b04fd9c0aa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.network.neutron [req-0e23bca1-9639-454f-95e2-f0bcd9be394e req-9256fbe6-0489-4ec1-9507-6136d105c734 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updated VIF entry in instance network info cache for port e2a9ec6f-08ed-4116-b0e2-c39099b07f7b. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.network.neutron [req-0e23bca1-9639-454f-95e2-f0bcd9be394e req-9256fbe6-0489-4ec1-9507-6136d105c734 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updating instance_info_cache with network_info: [{"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e23bca1-9639-454f-95e2-f0bcd9be394e req-9256fbe6-0489-4ec1-9507-6136d105c734 service nova] Releasing lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] No BDM found with device name hda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] No VIF found with MAC fa:16:3e:cc:c8:d3, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:34:15 user nova-compute[70869]:   <nova:package version="0.0.0"/>
Jul 25 15:34:15 user nova-compute[70869]:   <nova:name>tempest-device-tagging-server-1881880919</nova:name>
Jul 25 15:34:15 user nova-compute[70869]:   <nova:creationTime>2023-07-25 15:34:15</nova:creationTime>
Jul 25 15:34:15 user nova-compute[70869]:   <nova:flavor name="m1.tiny">
Jul 25 15:34:15 user nova-compute[70869]:     <nova:memory>512</nova:memory>
Jul 25 15:34:15 user nova-compute[70869]:     <nova:disk>1</nova:disk>
Jul 25 15:34:15 user nova-compute[70869]:     <nova:swap>0</nova:swap>
Jul 25 15:34:15 user nova-compute[70869]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:34:15 user nova-compute[70869]:     <nova:vcpus>1</nova:vcpus>
Jul 25 15:34:15 user nova-compute[70869]:   </nova:flavor>
Jul 25 15:34:15 user nova-compute[70869]:   <nova:owner>
Jul 25 15:34:15 user nova-compute[70869]:     <nova:user uuid="f21c066cfdbd498a9ac779e762799d2b">tempest-TaggedAttachmentsTest-1524187401-project-member</nova:user>
Jul 25 15:34:15 user nova-compute[70869]:     <nova:project uuid="5e5e728d1bdf4015b917d1d77e7a2e75">tempest-TaggedAttachmentsTest-1524187401</nova:project>
Jul 25 15:34:15 user nova-compute[70869]:   </nova:owner>
Jul 25 15:34:15 user nova-compute[70869]:   <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:34:15 user nova-compute[70869]:   <nova:ports>
Jul 25 15:34:15 user nova-compute[70869]:     <nova:port uuid="9911ada1-3a21-4e33-be13-d786a18560fd">
Jul 25 15:34:15 user nova-compute[70869]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:34:15 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:15 user nova-compute[70869]:     <nova:port uuid="e2a9ec6f-08ed-4116-b0e2-c39099b07f7b">
Jul 25 15:34:15 user nova-compute[70869]:       <nova:ip type="fixed" address="10.10.10.103" ipVersion="4"/>
Jul 25 15:34:15 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:15 user nova-compute[70869]:   </nova:ports>
Jul 25 15:34:15 user nova-compute[70869]: </nova:instance>
Jul 25 15:34:15 user nova-compute[70869]:  {{(pid=70869) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6323641-8bb8-4b3b-8fc2-f50e0a7f0919]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159, portal: 172.16.0.220,3260]
Jul 25 15:34:15 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:15 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-67ea9005-b8bb-4522-adae-6144647df517 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "interface-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.469s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[724c194e-f134-432e-a51f-e98cead1be1a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[357cfb03-6fbc-48bf-a9c4-d62b747a0ab4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:15 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.525s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lazy-loading 'flavor' on Instance uuid 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf535b18-487f-4ff3-8736-3f5dde16db0a]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTrVakim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:15 user nova-compute[70869]: INFO nova.compute.manager [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Attaching volume c64bcf20-da52-4885-a148-f2223b528064 to /dev/sdc
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lazy-loading 'flavor' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.utils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2beacf4-f1c5-4a2a-80f9-d1515d031807]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16ce8bf-8151-40e4-a83c-4fbc4b035df0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa1651b-225c-484d-a8ec-443bf13efccb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe732b-8874-43af-af81-df3ebf761ba0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.158s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:15 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0766e74-669d-46c7-a776-9848c6df6ffc]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG os_brick.utils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Updating existing volume attachment record: c7dbd7be-5664-40d8-89da-c4f2a417b3e3 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:15 user nova-compute[70869]: INFO nova.compute.manager [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Attaching volume 8c3e0dac-1884-4f31-a510-53e417f6757c to /dev/vdb
Jul 25 15:34:16 user nova-compute[70869]: DEBUG os_brick.utils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24becfeb-537f-4eb8-a345-ce15d8b91c8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9bf9bd-923b-46eb-9c43-fb5c49629b9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a445a3-7077-47da-900d-fd94b78f2836]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[41773e6e-5c19-4be2-ae28-daf63fefa7d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:16 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:34:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eafa82-a142-41f1-b935-a928b1e53706]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG os_brick.utils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updating existing volume attachment record: 1047d864-d733-425c-aeb0-c3a023c31daf {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.586s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] <== connect_volume: return (1588ms) {'type': 'block', 'scsi_wwn': '23834363932303733', 'path': '/dev/sdi'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834363932303733', 'path': '/dev/sdi'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lazy-loading 'flavor' on Instance uuid 08fa2836-717a-4893-8969-fcab677935a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:34:16 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:16 user nova-compute[70869]:   <source dev="/dev/sdi"/>
Jul 25 15:34:16 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:34:16 user nova-compute[70869]:   <serial>be1586aa-0ce7-42d1-82e0-dce218f21159</serial>
Jul 25 15:34:16 user nova-compute[70869]: </disk>
Jul 25 15:34:16 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] No VIF found with MAC fa:16:3e:98:5a:5f, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:34:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-9ff02cb9-ad39-425e-aa7c-4b815f0ac925 req-bea99fac-96c6-43a6-a812-2598b0202735 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-plugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9ff02cb9-ad39-425e-aa7c-4b815f0ac925 req-bea99fac-96c6-43a6-a812-2598b0202735 service nova] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9ff02cb9-ad39-425e-aa7c-4b815f0ac925 req-bea99fac-96c6-43a6-a812-2598b0202735 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9ff02cb9-ad39-425e-aa7c-4b815f0ac925 req-bea99fac-96c6-43a6-a812-2598b0202735 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-9ff02cb9-ad39-425e-aa7c-4b815f0ac925 req-bea99fac-96c6-43a6-a812-2598b0202735 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] No waiting events found dispatching network-vif-plugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:17 user nova-compute[70869]: WARNING nova.compute.manager [req-9ff02cb9-ad39-425e-aa7c-4b815f0ac925 req-bea99fac-96c6-43a6-a812-2598b0202735 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received unexpected event network-vif-plugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b for instance with vm_state active and task_state None.
Jul 25 15:34:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCrRewl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:19 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:19 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:19 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cad0502-8dc8-4df3-a27b-0aea4b90d7cf tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.788s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7450b3b-6c80-4672-88a7-08359eac8314]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:34:19 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fd9803-d17e-4099-a8a7-459e37607e08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd] added
Jul 25 15:34:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4906552-6fb3-49de-b506-98aed40c3821]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e013d6b-f87e-483f-af7c-8c4af018a089]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpCrRewl {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpCrRewl" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3430336-9e02-49b1-b121-9b5e053cbb4c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpCrRewl'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6446410f-a45f-4118-a2fc-984ddc5ebbdf]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f87fd-c25b-4abe-bae1-9329d55c7bd8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6b4a01-ec52-4500-b395-7223e6ed5561]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260]
Jul 25 15:34:19 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[55181fcd-9302-49ef-a903-a60733d122a4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad36b74-5c29-4058-ad23-69003a27c954]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.497s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f931171-2a86-443d-ad6c-19c8a874edee]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:34:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCrRewl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:20 user nova-compute[70869]: INFO nova.compute.manager [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Detaching volume be1586aa-0ce7-42d1-82e0-dce218f21159
Jul 25 15:34:20 user nova-compute[70869]: INFO nova.virt.block_device [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Attempting to driver detach volume be1586aa-0ce7-42d1-82e0-dce218f21159 from mountpoint /dev/vdb
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Attempting to detach device vdb from instance 08fa2836-717a-4893-8969-fcab677935a5 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:34:20 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:20 user nova-compute[70869]:   <source dev="/dev/sdi"/>
Jul 25 15:34:20 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:34:20 user nova-compute[70869]:   <serial>be1586aa-0ce7-42d1-82e0-dce218f21159</serial>
Jul 25 15:34:20 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:34:20 user nova-compute[70869]: </disk>
Jul 25 15:34:20 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:20 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Successfully detached device vdb from instance 08fa2836-717a-4893-8969-fcab677935a5 from the persistent domain config.
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08fa2836-717a-4893-8969-fcab677935a5 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:34:20 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:20 user nova-compute[70869]:   <source dev="/dev/sdi"/>
Jul 25 15:34:20 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:34:20 user nova-compute[70869]:   <serial>be1586aa-0ce7-42d1-82e0-dce218f21159</serial>
Jul 25 15:34:20 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:34:20 user nova-compute[70869]: </disk>
Jul 25 15:34:20 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299260.6363502, 08fa2836-717a-4893-8969-fcab677935a5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08fa2836-717a-4893-8969-fcab677935a5 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:34:20 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Successfully detached device vdb from instance 08fa2836-717a-4893-8969-fcab677935a5 from the live domain config.
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTrVakim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:20 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] <== connect_volume: return (1540ms) {'type': 'block', 'scsi_wwn': '23135323333663866', 'path': '/dev/sdj'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135323333663866', 'path': '/dev/sdj'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.058s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lazy-loading 'flavor' on Instance uuid 3a84f092-352e-4039-8dcb-bd4578458765 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a5a4e1-9e34-4d43-aa44-2bff7738d7d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:20 user nova-compute[70869]: No targets found.
Jul 25 15:34:20 user nova-compute[70869]: iSNS:
Jul 25 15:34:20 user nova-compute[70869]: No targets found.
Jul 25 15:34:20 user nova-compute[70869]: STATIC:
Jul 25 15:34:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159
Jul 25 15:34:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:34:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd
Jul 25 15:34:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491
Jul 25 15:34:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a
Jul 25 15:34:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:20 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:20 user nova-compute[70869]: No targets found.
Jul 25 15:34:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:20 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:20 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:34:20 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:20 user nova-compute[70869]:   <source dev="/dev/sdj"/>
Jul 25 15:34:20 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:34:20 user nova-compute[70869]:   <serial>e4415034-90d6-4b57-b797-d80bb15563bd</serial>
Jul 25 15:34:20 user nova-compute[70869]: </disk>
Jul 25 15:34:20 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef11c38-14c5-48dd-97d4-20688aff5eda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b786de9-e804-44a9-b3c4-624ab925ed3a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4430b2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159'): ({'sdi'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Removing single pathed devices sdi {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b587441-f478-4a93-8bf5-29c983262dba]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d4f43f-42b8-4168-bfbb-852d1fe568b8]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Flushing IO for device /dev/sdi {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b6b819-ad06-4aa2-b0dc-71af6f104c37]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2c1d4b-4c3a-4f72-9a82-c76a2348c587]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] SCSI volumes sdi have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24689438-6f31-44dd-ba02-4e34ab0f4955]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f999bac-e682-4a4e-a79c-ae79ac8205f3]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159, portal: 172.16.0.220,3260]
Jul 25 15:34:20 user nova-compute[70869]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be1586aa-0ce7-42d1-82e0-dce218f21159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:21 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[874e3deb-ec65-4dd7-b6a7-2037a2c8955b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:21 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:21 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:21 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] <== disconnect_volume: return (388ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] No VIF found with MAC fa:16:3e:8b:58:87, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:34:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:23 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:34:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnTauDyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:24 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:24 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:24 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b87746-de14-4025-8a77-cb4011641c2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:34:24 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14a43ac-f869-4007-be41-79bfd2b71984]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064] added
Jul 25 15:34:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7a230148-8992-4ef2-ae55-0ae508da65ae tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.591s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c11d04-e78d-4c43-baf6-62a7316e9a74]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74215d6-dbd5-4aad-9c51-0e93c4d3ad63]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnTauDyv {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnTauDyv" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ef1e40-b354-465b-ba84-9b1c47b3a46e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tnTauDyv'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[33402a51-ec98-4a9a-b2ba-1c8a3320e889]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[681381ac-4c04-4f5d-a3ef-0a8da0a8c957]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f9fd6f-0e94-4368-ab0c-9525aea843a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064, portal: 172.16.0.220,3260]
Jul 25 15:34:24 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ebce8f-90a1-43de-b1f7-11cfafaa1de9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[deacf860-dcad-412a-938c-11b964fe4b73]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee218f7-c714-466c-8c40-bdc3b04291f3]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnTauDyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updating instance_info_cache with network_info: [{"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "3a84f092-352e-4039-8dcb-bd4578458765" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG os_brick.utils [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc06d65-e095-40d9-920d-fbfe45ddb69f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec2731b-935b-4e2c-bd07-ec0b2ea46490]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef3848c-e906-4881-afaa-2b215f8b4b04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0318c078-b1d7-4a8c-8deb-f7fb3f6ff7c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:25 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:34:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282f437-3f52-4b87-891a-a5be77c0c735]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG os_brick.utils [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:25 user nova-compute[70869]: INFO nova.compute.manager [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Swapping volume e4415034-90d6-4b57-b797-d80bb15563bd for 71a63402-649d-4f1c-8016-303dff7eea8f
Jul 25 15:34:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26635623438323332', 'path': '/dev/sdi'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635623438323332', 'path': '/dev/sdi'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lazy-loading 'flavor' on Instance uuid 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:34:25 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:25 user nova-compute[70869]:   <source dev="/dev/sdi"/>
Jul 25 15:34:25 user nova-compute[70869]:   <target dev="sdc" bus="scsi"/>
Jul 25 15:34:25 user nova-compute[70869]:   <serial>c64bcf20-da52-4885-a148-f2223b528064</serial>
Jul 25 15:34:25 user nova-compute[70869]:   <address type="drive" controller="0" unit="2"/>
Jul 25 15:34:25 user nova-compute[70869]: </disk>
Jul 25 15:34:25 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:34:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] No BDM found with device name sda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] No VIF found with MAC fa:16:3e:73:da:73, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:34:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:34:27 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:34:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lazy-loading 'flavor' on Instance uuid 08fa2836-717a-4893-8969-fcab677935a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5786ab8d-62fa-468e-869d-b28c63812bc7 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzNkVGrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:28 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3716bdc5-736c-4bac-a43c-355067f8ce50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:34:28 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2a4def-c5fe-4702-b5fb-b0aa273dfbc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c] added
Jul 25 15:34:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9306eb-a6e6-4045-80ad-c9872fe7f7e3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d56a0bf4-a8e6-40e2-89e7-1c83da3d1ad3 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.725s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d2c3c8-fcf1-4218-afeb-fdc4e9129865]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lzNkVGrp {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lzNkVGrp" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[68245ee6-2e82-421d-bce0-6e65dfa97b12]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lzNkVGrp'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ccf6c4-3d99-43a2-ac51-83b111d6e1b2]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57fdf66-39c8-4ac5-9d02-c184cc50ff6c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43246d1-ad52-4c00-8f01-0193078416f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c, portal: 172.16.0.220,3260]
Jul 25 15:34:28 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58dd250-5142-49ba-bad9-23cc262ea257]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a90061-eb4d-406a-b3c3-cbd8c04f6502]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f26971-cad6-4524-9f9c-f3ff75ffa6bd]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzNkVGrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:34:28 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23336653763623331', 'path': '/dev/sdk'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336653763623331', 'path': '/dev/sdk'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lazy-loading 'flavor' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:34:29 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:29 user nova-compute[70869]:   <source dev="/dev/sdk"/>
Jul 25 15:34:29 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:34:29 user nova-compute[70869]:   <serial>8c3e0dac-1884-4f31-a510-53e417f6757c</serial>
Jul 25 15:34:29 user nova-compute[70869]: </disk>
Jul 25 15:34:29 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:29 user nova-compute[70869]: INFO nova.compute.manager [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Detaching volume c64bcf20-da52-4885-a148-f2223b528064
Jul 25 15:34:29 user nova-compute[70869]: INFO nova.virt.block_device [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Attempting to driver detach volume c64bcf20-da52-4885-a148-f2223b528064 from mountpoint /dev/sdc
Jul 25 15:34:29 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Attempting to detach device sdc from instance 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:34:29 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:29 user nova-compute[70869]:   <source dev="/dev/sdi"/>
Jul 25 15:34:29 user nova-compute[70869]:   <target dev="sdc" bus="scsi"/>
Jul 25 15:34:29 user nova-compute[70869]:   <serial>c64bcf20-da52-4885-a148-f2223b528064</serial>
Jul 25 15:34:29 user nova-compute[70869]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 25 15:34:29 user nova-compute[70869]: </disk>
Jul 25 15:34:29 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:29 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Successfully detached device sdc from instance 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 from the persistent domain config.
Jul 25 15:34:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:34:29 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:29 user nova-compute[70869]:   <source dev="/dev/sdi"/>
Jul 25 15:34:29 user nova-compute[70869]:   <target dev="sdc" bus="scsi"/>
Jul 25 15:34:29 user nova-compute[70869]:   <serial>c64bcf20-da52-4885-a148-f2223b528064</serial>
Jul 25 15:34:29 user nova-compute[70869]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 25 15:34:29 user nova-compute[70869]: </disk>
Jul 25 15:34:29 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:29 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] No BDM found with device name hda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] No VIF found with MAC fa:16:3e:cc:c8:d3, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4754a23f-5bc3-41ae-a8a4-ddd38b855084 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.243s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299270.2735932, 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:34:30 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Successfully detached device sdc from instance 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 from the live domain config.
Jul 25 15:34:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnTauDyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:30 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[241fa2eb-0e30-4064-a58d-a5cb42e7d612]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:30 user nova-compute[70869]: No targets found.
Jul 25 15:34:30 user nova-compute[70869]: iSNS:
Jul 25 15:34:30 user nova-compute[70869]: No targets found.
Jul 25 15:34:30 user nova-compute[70869]: STATIC:
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c
Jul 25 15:34:30 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:30 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:30 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:30 user nova-compute[70869]: No targets found.
Jul 25 15:34:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:30 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:30 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f725f5-26f9-4f26-9a06-f4e368510859]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[87300557-c34e-4ef8-ba7b-e14f5a14ade9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43da14ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064'): ({'sdi'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Removing single pathed devices sdi {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33de7a9-c2c7-4467-b0c4-4d6717fa1b29]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[371282b8-2831-4f5b-8602-0dec7d5d3081]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Flushing IO for device /dev/sdi {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c86e531-37e1-4497-95ce-362e52350df3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae7421c-ee3d-4153-a4f8-a778d2cae8d9]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] SCSI volumes sdi have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebe6bec-4c4c-42e6-9608-e830fc7bae67]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6012b7-75cc-429b-984e-9e5f8cddbbb9]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064, portal: 172.16.0.220,3260]
Jul 25 15:34:30 user nova-compute[70869]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c64bcf20-da52-4885-a148-f2223b528064 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8fe005-f0fc-4500-b077-0038a6939ff7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] <== disconnect_volume: return (404ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:34:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:31 user nova-compute[70869]: INFO nova.compute.manager [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Detaching volume 8c3e0dac-1884-4f31-a510-53e417f6757c
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: INFO nova.virt.block_device [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Attempting to driver detach volume 8c3e0dac-1884-4f31-a510-53e417f6757c from mountpoint /dev/vdb
Jul 25 15:34:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Attempting to detach device vdb from instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:34:31 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:31 user nova-compute[70869]:   <source dev="/dev/sdk"/>
Jul 25 15:34:31 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:34:31 user nova-compute[70869]:   <serial>8c3e0dac-1884-4f31-a510-53e417f6757c</serial>
Jul 25 15:34:31 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 15:34:31 user nova-compute[70869]: </disk>
Jul 25 15:34:31 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:31 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Successfully detached device vdb from instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff from the persistent domain config.
Jul 25 15:34:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:34:31 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:31 user nova-compute[70869]:   <source dev="/dev/sdk"/>
Jul 25 15:34:31 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:34:31 user nova-compute[70869]:   <serial>8c3e0dac-1884-4f31-a510-53e417f6757c</serial>
Jul 25 15:34:31 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 15:34:31 user nova-compute[70869]: </disk>
Jul 25 15:34:31 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lazy-loading 'flavor' on Instance uuid 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d78a2085-f5a7-48be-a83b-d168c2339304 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.909s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299271.6144552, b6c9b6d1-5006-4160-a559-ea5c46e7c4ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:34:31 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Successfully detached device vdb from instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff from the live domain config.
Jul 25 15:34:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzNkVGrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:31 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dfe1d1-6acf-4722-a7f9-480231f9622a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:31 user nova-compute[70869]: No targets found.
Jul 25 15:34:31 user nova-compute[70869]: iSNS:
Jul 25 15:34:31 user nova-compute[70869]: No targets found.
Jul 25 15:34:31 user nova-compute[70869]: STATIC:
Jul 25 15:34:31 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:34:31 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:31 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:31 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:31 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:31 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:31 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:31 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:31 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:31 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:31 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:31 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:31 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd
Jul 25 15:34:31 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:31 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:31 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:31 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:31 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:31 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491
Jul 25 15:34:31 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:31 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:31 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a
Jul 25 15:34:31 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:31 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:31 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c
Jul 25 15:34:31 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:31 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:31 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:31 user nova-compute[70869]: No targets found.
Jul 25 15:34:31 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:31 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:31 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42205cb-0760-4cdd-bedd-f53ec1c44fce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0259e9-f32e-4922-842c-f48231bfeb2e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:31 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c37a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c'): ({'sdk'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Removing single pathed devices sdk {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d163720f-86a6-4e20-b1fc-db01f03b96ed]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f1c58e-943e-4e87-86b3-fe9802dbca2b]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Flushing IO for device /dev/sdk {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c1234d-1de4-4b30-9a51-c076390bd53c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce20977b-561f-4ace-8f0b-9234ee6ebb11]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] SCSI volumes sdk have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c94e952-944e-4ccb-900d-d813c7a2be96]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31e8254-9dd9-4445-a67d-f85e3911506c]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c, portal: 172.16.0.220,3260]
Jul 25 15:34:31 user nova-compute[70869]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:31 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c3e0dac-1884-4f31-a510-53e417f6757c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdb795f-713a-44fa-afd2-f83a70c26c50]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] <== disconnect_volume: return (370ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:32 user nova-compute[70869]: INFO nova.compute.manager [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Terminating instance
Jul 25 15:34:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-6090cd10-c044-4667-aaf8-c20c140518db req-e8319326-1f76-4824-93dc-c4f3dd445b12 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received event network-vif-unplugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6090cd10-c044-4667-aaf8-c20c140518db req-e8319326-1f76-4824-93dc-c4f3dd445b12 service nova] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6090cd10-c044-4667-aaf8-c20c140518db req-e8319326-1f76-4824-93dc-c4f3dd445b12 service nova] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6090cd10-c044-4667-aaf8-c20c140518db req-e8319326-1f76-4824-93dc-c4f3dd445b12 service nova] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-6090cd10-c044-4667-aaf8-c20c140518db req-e8319326-1f76-4824-93dc-c4f3dd445b12 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] No waiting events found dispatching network-vif-unplugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-6090cd10-c044-4667-aaf8-c20c140518db req-e8319326-1f76-4824-93dc-c4f3dd445b12 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received event network-vif-unplugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKweCBgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a84f092-352e-4039-8dcb-bd4578458765', 'attached_at': '', 'detached_at': '', 'volume_id': '71a63402-649d-4f1c-8016-303dff7eea8f', 'serial': '71a63402-649d-4f1c-8016-303dff7eea8f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCrRewl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '3a84f092-352e-4039-8dcb-bd4578458765', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4415034-90d6-4b57-b797-d80bb15563bd', 'serial'} {{(pid=70869) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKweCBgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:32 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:32 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:32 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d4081b-8314-4216-985c-f5d9816d235c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:34:32 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a282f1-4420-4057-bdfd-2f720b8cc3d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f] added
Jul 25 15:34:32 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffbb81d-c277-4c35-8b85-4c8441f0f66b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:32 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lazy-loading 'flavor' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09c2d67-afd9-4fdd-8600-7e2ba344d238]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKweCBgc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKweCBgc" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d08a6c7-afdf-46a2-8ab0-90812db16522]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tKweCBgc'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.096s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60859e9-af29-4453-acc8-1372d2261f1a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e175f9-9e4d-4a70-b54c-5ca716dac589]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3293d240-8e77-499f-823b-f326f82e5148 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.210s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Instance destroyed successfully.
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lazy-loading 'resources' on Instance uuid 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1884369105',display_name='tempest-AttachSCSIVolumeTestJSON-server-1884369105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1884369105',id=10,image_ref='aa0f69e0-2bfb-4d53-8589-81e36f386fd0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw8zi87+wGXCP7RLTtFdU6LEEezPfYJtYWXWZF8LivMwb0+9kTun2GBjW6DN9vjSP+D+RHavSaXLYD6OW9PzuSXyYaX7Zm+K+yxahyAxv78zmW/7zj6HAqhogrVh4Ha/Q==',key_name='tempest-keypair-907253329',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05df151eb8f9406b8714421b1e7af0e6',ramdisk_id='',reservation_id='r-quwo9g9k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa0f69e0-2bfb-4d53-8589-81e36f386fd0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-221261173',owner_user_name='tempest-AttachSCSIVolumeTestJSON-221261173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e1e8710f4904363a23e996fc5ef8e2c',uuid=3927367a-ad7c-4ad7-9812-4b0199e9a9a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Converting VIF {"id": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "address": "fa:16:3e:73:da:73", "network": {"id": "330b3a38-d9af-4cb2-86c5-3d501a783659", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1481951601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05df151eb8f9406b8714421b1e7af0e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99306340-f2", "ovs_interfaceid": "99306340-f2ac-483c-99d4-bf4a0fd05c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:da:73,bridge_name='br-int',has_traffic_filtering=True,id=99306340-f2ac-483c-99d4-bf4a0fd05c25,network=Network(330b3a38-d9af-4cb2-86c5-3d501a783659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99306340-f2') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_vif [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:da:73,bridge_name='br-int',has_traffic_filtering=True,id=99306340-f2ac-483c-99d4-bf4a0fd05c25,network=Network(330b3a38-d9af-4cb2-86c5-3d501a783659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99306340-f2') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99306340-f2, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "interface-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "interface-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:33 user nova-compute[70869]: INFO os_vif [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:da:73,bridge_name='br-int',has_traffic_filtering=True,id=99306340-f2ac-483c-99d4-bf4a0fd05c25,network=Network(330b3a38-d9af-4cb2-86c5-3d501a783659),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99306340-f2')
Jul 25 15:34:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Deleting instance files /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1_del
Jul 25 15:34:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Deletion of /opt/stack/data/nova/instances/3927367a-ad7c-4ad7-9812-4b0199e9a9a1_del complete
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[157847c6-d028-471a-bc19-c0d299371ed6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f, portal: 172.16.0.220,3260]
Jul 25 15:34:33 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73c999b-bca7-4aa5-a0af-31703b096b08]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lazy-loading 'flavor' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:33 user nova-compute[70869]: INFO nova.compute.manager [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881880919',id=9,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCnjUFS4GVvp1uY+i4MWSiPTipwFlk1fAmhL09GyrCSrjDVSQvYyS8MW2Ahfcl4CTdExtioOorFgZMog5w/XI0cedHfxpHuJtENl/M1IXTFU2CPc7Y1H/+dLskGA8s5g==',key_name='tempest-keypair-1573765752',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e5e728d1bdf4015b917d1d77e7a2e75',ramdisk_id='',reservation_id='r-enxwzktb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1524187401',owner_user_name='tempest-TaggedAttachmentsTest-1524187401-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21c066cfdbd498a9ac779e762799d2b',uuid=b6c9b6d1-5006-4160-a559-ea5c46e7c4ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converting VIF {"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface> {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface> {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Attempting to detach device tape2a9ec6f-08 from instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] detach device xml: <interface type="ethernet">
Jul 25 15:34:33 user nova-compute[70869]:   <mac address="fa:16:3e:72:1c:6b"/>
Jul 25 15:34:33 user nova-compute[70869]:   <model type="virtio"/>
Jul 25 15:34:33 user nova-compute[70869]:   <mtu size="1442"/>
Jul 25 15:34:33 user nova-compute[70869]:   <target dev="tape2a9ec6f-08"/>
Jul 25 15:34:33 user nova-compute[70869]: </interface>
Jul 25 15:34:33 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2158ea7c-5cd3-453d-a8d2-ae84810ef595]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.570s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface> {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 25 15:34:33 user nova-compute[70869]:   <name>instance-00000009</name>
Jul 25 15:34:33 user nova-compute[70869]:   <uuid>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</uuid>
Jul 25 15:34:33 user nova-compute[70869]:   <metadata>
Jul 25 15:34:33 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:34:33 user nova-compute[70869]:   <nova:package version="0.0.0"/>
Jul 25 15:34:33 user nova-compute[70869]:   <nova:name>tempest-device-tagging-server-1881880919</nova:name>
Jul 25 15:34:33 user nova-compute[70869]:   <nova:creationTime>2023-07-25 15:34:15</nova:creationTime>
Jul 25 15:34:33 user nova-compute[70869]:   <nova:flavor name="m1.tiny">
Jul 25 15:34:33 user nova-compute[70869]:     <nova:memory>512</nova:memory>
Jul 25 15:34:33 user nova-compute[70869]:     <nova:disk>1</nova:disk>
Jul 25 15:34:33 user nova-compute[70869]:     <nova:swap>0</nova:swap>
Jul 25 15:34:33 user nova-compute[70869]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:34:33 user nova-compute[70869]:     <nova:vcpus>1</nova:vcpus>
Jul 25 15:34:33 user nova-compute[70869]:   </nova:flavor>
Jul 25 15:34:33 user nova-compute[70869]:   <nova:owner>
Jul 25 15:34:33 user nova-compute[70869]:     <nova:user uuid="f21c066cfdbd498a9ac779e762799d2b">tempest-TaggedAttachmentsTest-1524187401-project-member</nova:user>
Jul 25 15:34:33 user nova-compute[70869]:     <nova:project uuid="5e5e728d1bdf4015b917d1d77e7a2e75">tempest-TaggedAttachmentsTest-1524187401</nova:project>
Jul 25 15:34:33 user nova-compute[70869]:   </nova:owner>
Jul 25 15:34:33 user nova-compute[70869]:   <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:34:33 user nova-compute[70869]:   <nova:ports>
Jul 25 15:34:33 user nova-compute[70869]:     <nova:port uuid="9911ada1-3a21-4e33-be13-d786a18560fd">
Jul 25 15:34:33 user nova-compute[70869]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:34:33 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:33 user nova-compute[70869]:     <nova:port uuid="e2a9ec6f-08ed-4116-b0e2-c39099b07f7b">
Jul 25 15:34:33 user nova-compute[70869]:       <nova:ip type="fixed" address="10.10.10.103" ipVersion="4"/>
Jul 25 15:34:33 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:33 user nova-compute[70869]:   </nova:ports>
Jul 25 15:34:33 user nova-compute[70869]: </nova:instance>
Jul 25 15:34:33 user nova-compute[70869]:   </metadata>
Jul 25 15:34:33 user nova-compute[70869]:   <memory unit='KiB'>524288</memory>
Jul 25 15:34:33 user nova-compute[70869]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 15:34:33 user nova-compute[70869]:   <vcpu placement='static'>1</vcpu>
Jul 25 15:34:33 user nova-compute[70869]:   <resource>
Jul 25 15:34:33 user nova-compute[70869]:     <partition>/machine</partition>
Jul 25 15:34:33 user nova-compute[70869]:   </resource>
Jul 25 15:34:33 user nova-compute[70869]:   <sysinfo type='smbios'>
Jul 25 15:34:33 user nova-compute[70869]:     <system>
Jul 25 15:34:33 user nova-compute[70869]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 15:34:33 user nova-compute[70869]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 15:34:33 user nova-compute[70869]:       <entry name='version'>0.0.0</entry>
Jul 25 15:34:33 user nova-compute[70869]:       <entry name='serial'>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:34:33 user nova-compute[70869]:       <entry name='uuid'>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:34:33 user nova-compute[70869]:       <entry name='family'>Virtual Machine</entry>
Jul 25 15:34:33 user nova-compute[70869]:     </system>
Jul 25 15:34:33 user nova-compute[70869]:   </sysinfo>
Jul 25 15:34:33 user nova-compute[70869]:   <os>
Jul 25 15:34:33 user nova-compute[70869]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 15:34:33 user nova-compute[70869]:     <boot dev='hd'/>
Jul 25 15:34:33 user nova-compute[70869]:     <smbios mode='sysinfo'/>
Jul 25 15:34:33 user nova-compute[70869]:   </os>
Jul 25 15:34:33 user nova-compute[70869]:   <features>
Jul 25 15:34:33 user nova-compute[70869]:     <acpi/>
Jul 25 15:34:33 user nova-compute[70869]:     <apic/>
Jul 25 15:34:33 user nova-compute[70869]:     <vmcoreinfo state='on'/>
Jul 25 15:34:33 user nova-compute[70869]:   </features>
Jul 25 15:34:33 user nova-compute[70869]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 15:34:33 user nova-compute[70869]:     <model fallback='forbid'>Nehalem</model>
Jul 25 15:34:33 user nova-compute[70869]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 15:34:33 user nova-compute[70869]:     <feature policy='require' name='vme'/>
Jul 25 15:34:33 user nova-compute[70869]:     <feature policy='require' name='x2apic'/>
Jul 25 15:34:33 user nova-compute[70869]:     <feature policy='require' name='hypervisor'/>
Jul 25 15:34:33 user nova-compute[70869]:   </cpu>
Jul 25 15:34:33 user nova-compute[70869]:   <clock offset='utc'>
Jul 25 15:34:33 user nova-compute[70869]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 15:34:33 user nova-compute[70869]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 15:34:33 user nova-compute[70869]:     <timer name='hpet' present='no'/>
Jul 25 15:34:33 user nova-compute[70869]:   </clock>
Jul 25 15:34:33 user nova-compute[70869]:   <on_poweroff>destroy</on_poweroff>
Jul 25 15:34:33 user nova-compute[70869]:   <on_reboot>restart</on_reboot>
Jul 25 15:34:33 user nova-compute[70869]:   <on_crash>destroy</on_crash>
Jul 25 15:34:33 user nova-compute[70869]:   <devices>
Jul 25 15:34:33 user nova-compute[70869]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 15:34:33 user nova-compute[70869]:     <disk type='file' device='disk'>
Jul 25 15:34:33 user nova-compute[70869]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 15:34:33 user nova-compute[70869]:       <source file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk' index='2'/>
Jul 25 15:34:33 user nova-compute[70869]:       <backingStore type='file' index='3'>
Jul 25 15:34:33 user nova-compute[70869]:         <format type='raw'/>
Jul 25 15:34:33 user nova-compute[70869]:         <source file='/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319'/>
Jul 25 15:34:33 user nova-compute[70869]:         <backingStore/>
Jul 25 15:34:33 user nova-compute[70869]:       </backingStore>
Jul 25 15:34:33 user nova-compute[70869]:       <target dev='vda' bus='virtio'/>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='virtio-disk0'/>
Jul 25 15:34:33 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </disk>
Jul 25 15:34:33 user nova-compute[70869]:     <disk type='file' device='cdrom'>
Jul 25 15:34:33 user nova-compute[70869]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 15:34:33 user nova-compute[70869]:       <source file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.config' index='1'/>
Jul 25 15:34:33 user nova-compute[70869]:       <backingStore/>
Jul 25 15:34:33 user nova-compute[70869]:       <target dev='hda' bus='ide'/>
Jul 25 15:34:33 user nova-compute[70869]:       <readonly/>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='ide0-0-0'/>
Jul 25 15:34:33 user nova-compute[70869]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </disk>
Jul 25 15:34:33 user nova-compute[70869]:     <controller type='usb' index='0' model='none'>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='usb'/>
Jul 25 15:34:33 user nova-compute[70869]:     </controller>
Jul 25 15:34:33 user nova-compute[70869]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='pci.0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </controller>
Jul 25 15:34:33 user nova-compute[70869]:     <controller type='ide' index='0'>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='ide'/>
Jul 25 15:34:33 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 15:34:33 user nova-compute[70869]:     </controller>
Jul 25 15:34:33 user nova-compute[70869]:     <interface type='ethernet'>
Jul 25 15:34:33 user nova-compute[70869]:       <mac address='fa:16:3e:cc:c8:d3'/>
Jul 25 15:34:33 user nova-compute[70869]:       <target dev='tap9911ada1-3a'/>
Jul 25 15:34:33 user nova-compute[70869]:       <model type='virtio'/>
Jul 25 15:34:33 user nova-compute[70869]:       <mtu size='1442'/>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='net0'/>
Jul 25 15:34:33 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </interface>
Jul 25 15:34:33 user nova-compute[70869]:     <interface type='ethernet'>
Jul 25 15:34:33 user nova-compute[70869]:       <mac address='fa:16:3e:72:1c:6b'/>
Jul 25 15:34:33 user nova-compute[70869]:       <target dev='tape2a9ec6f-08'/>
Jul 25 15:34:33 user nova-compute[70869]:       <model type='virtio'/>
Jul 25 15:34:33 user nova-compute[70869]:       <mtu size='1442'/>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='net1'/>
Jul 25 15:34:33 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </interface>
Jul 25 15:34:33 user nova-compute[70869]:     <serial type='pty'>
Jul 25 15:34:33 user nova-compute[70869]:       <source path='/dev/pts/8'/>
Jul 25 15:34:33 user nova-compute[70869]:       <log file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log' append='off'/>
Jul 25 15:34:33 user nova-compute[70869]:       <target type='isa-serial' port='0'>
Jul 25 15:34:33 user nova-compute[70869]:         <model name='isa-serial'/>
Jul 25 15:34:33 user nova-compute[70869]:       </target>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='serial0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </serial>
Jul 25 15:34:33 user nova-compute[70869]:     <console type='pty' tty='/dev/pts/8'>
Jul 25 15:34:33 user nova-compute[70869]:       <source path='/dev/pts/8'/>
Jul 25 15:34:33 user nova-compute[70869]:       <log file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log' append='off'/>
Jul 25 15:34:33 user nova-compute[70869]:       <target type='serial' port='0'/>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='serial0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </console>
Jul 25 15:34:33 user nova-compute[70869]:     <input type='mouse' bus='ps2'>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='input0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </input>
Jul 25 15:34:33 user nova-compute[70869]:     <input type='keyboard' bus='ps2'>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='input1'/>
Jul 25 15:34:33 user nova-compute[70869]:     </input>
Jul 25 15:34:33 user nova-compute[70869]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 25 15:34:33 user nova-compute[70869]:       <listen type='address' address='0.0.0.0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </graphics>
Jul 25 15:34:33 user nova-compute[70869]:     <audio id='1' type='none'/>
Jul 25 15:34:33 user nova-compute[70869]:     <video>
Jul 25 15:34:33 user nova-compute[70869]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='video0'/>
Jul 25 15:34:33 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </video>
Jul 25 15:34:33 user nova-compute[70869]:     <memballoon model='virtio'>
Jul 25 15:34:33 user nova-compute[70869]:       <stats period='10'/>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='balloon0'/>
Jul 25 15:34:33 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </memballoon>
Jul 25 15:34:33 user nova-compute[70869]:     <rng model='virtio'>
Jul 25 15:34:33 user nova-compute[70869]:       <backend model='random'>/dev/urandom</backend>
Jul 25 15:34:33 user nova-compute[70869]:       <alias name='rng0'/>
Jul 25 15:34:33 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 15:34:33 user nova-compute[70869]:     </rng>
Jul 25 15:34:33 user nova-compute[70869]:   </devices>
Jul 25 15:34:33 user nova-compute[70869]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 15:34:33 user nova-compute[70869]:     <label>libvirt-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</label>
Jul 25 15:34:33 user nova-compute[70869]:     <imagelabel>libvirt-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</imagelabel>
Jul 25 15:34:33 user nova-compute[70869]:   </seclabel>
Jul 25 15:34:33 user nova-compute[70869]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 15:34:33 user nova-compute[70869]:     <label>+64055:+108</label>
Jul 25 15:34:33 user nova-compute[70869]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 15:34:33 user nova-compute[70869]:   </seclabel>
Jul 25 15:34:33 user nova-compute[70869]: </domain>
Jul 25 15:34:33 user nova-compute[70869]:  {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 15:34:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Successfully detached device tape2a9ec6f-08 from instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff from the persistent domain config.
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] (1/8): Attempting to detach device tape2a9ec6f-08 with device alias net1 from instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] detach device xml: <interface type="ethernet">
Jul 25 15:34:33 user nova-compute[70869]:   <mac address="fa:16:3e:72:1c:6b"/>
Jul 25 15:34:33 user nova-compute[70869]:   <model type="virtio"/>
Jul 25 15:34:33 user nova-compute[70869]:   <mtu size="1442"/>
Jul 25 15:34:33 user nova-compute[70869]:   <target dev="tape2a9ec6f-08"/>
Jul 25 15:34:33 user nova-compute[70869]: </interface>
Jul 25 15:34:33 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[62075187-4595-4bdb-af4d-d477c13cf66f]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKweCBgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:34:33 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '3927367a-ad7c-4ad7-9812-4b0199e9a9a1' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '3927367a-ad7c-4ad7-9812-4b0199e9a9a1' (instance-0000000a)
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:34:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299273.7018154, b6c9b6d1-5006-4160-a559-ea5c46e7c4ff => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-6c57c3a9-2a29-47c3-a2d6-de86bb73495c req-85c073c2-63d5-42ed-818e-6ae1e660ae59 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-unplugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6c57c3a9-2a29-47c3-a2d6-de86bb73495c req-85c073c2-63d5-42ed-818e-6ae1e660ae59 service nova] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6c57c3a9-2a29-47c3-a2d6-de86bb73495c req-85c073c2-63d5-42ed-818e-6ae1e660ae59 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6c57c3a9-2a29-47c3-a2d6-de86bb73495c req-85c073c2-63d5-42ed-818e-6ae1e660ae59 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-6c57c3a9-2a29-47c3-a2d6-de86bb73495c req-85c073c2-63d5-42ed-818e-6ae1e660ae59 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] No waiting events found dispatching network-vif-unplugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:34 user nova-compute[70869]: WARNING nova.compute.manager [req-6c57c3a9-2a29-47c3-a2d6-de86bb73495c req-85c073c2-63d5-42ed-818e-6ae1e660ae59 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received unexpected event network-vif-unplugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b for instance with vm_state active and task_state None.
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Start waiting for the detach event from libvirt for device tape2a9ec6f-08 with device alias net1 for instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface> {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 25 15:34:34 user nova-compute[70869]:   <name>instance-00000009</name>
Jul 25 15:34:34 user nova-compute[70869]:   <uuid>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</uuid>
Jul 25 15:34:34 user nova-compute[70869]:   <metadata>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:34:34 user nova-compute[70869]:   <nova:package version="0.0.0"/>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:name>tempest-device-tagging-server-1881880919</nova:name>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:creationTime>2023-07-25 15:34:15</nova:creationTime>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:flavor name="m1.tiny">
Jul 25 15:34:34 user nova-compute[70869]:     <nova:memory>512</nova:memory>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:disk>1</nova:disk>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:swap>0</nova:swap>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:vcpus>1</nova:vcpus>
Jul 25 15:34:34 user nova-compute[70869]:   </nova:flavor>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:owner>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:user uuid="f21c066cfdbd498a9ac779e762799d2b">tempest-TaggedAttachmentsTest-1524187401-project-member</nova:user>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:project uuid="5e5e728d1bdf4015b917d1d77e7a2e75">tempest-TaggedAttachmentsTest-1524187401</nova:project>
Jul 25 15:34:34 user nova-compute[70869]:   </nova:owner>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:ports>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:port uuid="9911ada1-3a21-4e33-be13-d786a18560fd">
Jul 25 15:34:34 user nova-compute[70869]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:34:34 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:port uuid="e2a9ec6f-08ed-4116-b0e2-c39099b07f7b">
Jul 25 15:34:34 user nova-compute[70869]:       <nova:ip type="fixed" address="10.10.10.103" ipVersion="4"/>
Jul 25 15:34:34 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:34 user nova-compute[70869]:   </nova:ports>
Jul 25 15:34:34 user nova-compute[70869]: </nova:instance>
Jul 25 15:34:34 user nova-compute[70869]:   </metadata>
Jul 25 15:34:34 user nova-compute[70869]:   <memory unit='KiB'>524288</memory>
Jul 25 15:34:34 user nova-compute[70869]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 15:34:34 user nova-compute[70869]:   <vcpu placement='static'>1</vcpu>
Jul 25 15:34:34 user nova-compute[70869]:   <resource>
Jul 25 15:34:34 user nova-compute[70869]:     <partition>/machine</partition>
Jul 25 15:34:34 user nova-compute[70869]:   </resource>
Jul 25 15:34:34 user nova-compute[70869]:   <sysinfo type='smbios'>
Jul 25 15:34:34 user nova-compute[70869]:     <system>
Jul 25 15:34:34 user nova-compute[70869]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 15:34:34 user nova-compute[70869]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 15:34:34 user nova-compute[70869]:       <entry name='version'>0.0.0</entry>
Jul 25 15:34:34 user nova-compute[70869]:       <entry name='serial'>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:34:34 user nova-compute[70869]:       <entry name='uuid'>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:34:34 user nova-compute[70869]:       <entry name='family'>Virtual Machine</entry>
Jul 25 15:34:34 user nova-compute[70869]:     </system>
Jul 25 15:34:34 user nova-compute[70869]:   </sysinfo>
Jul 25 15:34:34 user nova-compute[70869]:   <os>
Jul 25 15:34:34 user nova-compute[70869]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 15:34:34 user nova-compute[70869]:     <boot dev='hd'/>
Jul 25 15:34:34 user nova-compute[70869]:     <smbios mode='sysinfo'/>
Jul 25 15:34:34 user nova-compute[70869]:   </os>
Jul 25 15:34:34 user nova-compute[70869]:   <features>
Jul 25 15:34:34 user nova-compute[70869]:     <acpi/>
Jul 25 15:34:34 user nova-compute[70869]:     <apic/>
Jul 25 15:34:34 user nova-compute[70869]:     <vmcoreinfo state='on'/>
Jul 25 15:34:34 user nova-compute[70869]:   </features>
Jul 25 15:34:34 user nova-compute[70869]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 15:34:34 user nova-compute[70869]:     <model fallback='forbid'>Nehalem</model>
Jul 25 15:34:34 user nova-compute[70869]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 15:34:34 user nova-compute[70869]:     <feature policy='require' name='vme'/>
Jul 25 15:34:34 user nova-compute[70869]:     <feature policy='require' name='x2apic'/>
Jul 25 15:34:34 user nova-compute[70869]:     <feature policy='require' name='hypervisor'/>
Jul 25 15:34:34 user nova-compute[70869]:   </cpu>
Jul 25 15:34:34 user nova-compute[70869]:   <clock offset='utc'>
Jul 25 15:34:34 user nova-compute[70869]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 15:34:34 user nova-compute[70869]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 15:34:34 user nova-compute[70869]:     <timer name='hpet' present='no'/>
Jul 25 15:34:34 user nova-compute[70869]:   </clock>
Jul 25 15:34:34 user nova-compute[70869]:   <on_poweroff>destroy</on_poweroff>
Jul 25 15:34:34 user nova-compute[70869]:   <on_reboot>restart</on_reboot>
Jul 25 15:34:34 user nova-compute[70869]:   <on_crash>destroy</on_crash>
Jul 25 15:34:34 user nova-compute[70869]:   <devices>
Jul 25 15:34:34 user nova-compute[70869]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 15:34:34 user nova-compute[70869]:     <disk type='file' device='disk'>
Jul 25 15:34:34 user nova-compute[70869]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 15:34:34 user nova-compute[70869]:       <source file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk' index='2'/>
Jul 25 15:34:34 user nova-compute[70869]:       <backingStore type='file' index='3'>
Jul 25 15:34:34 user nova-compute[70869]:         <format type='raw'/>
Jul 25 15:34:34 user nova-compute[70869]:         <source file='/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319'/>
Jul 25 15:34:34 user nova-compute[70869]:         <backingStore/>
Jul 25 15:34:34 user nova-compute[70869]:       </backingStore>
Jul 25 15:34:34 user nova-compute[70869]:       <target dev='vda' bus='virtio'/>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='virtio-disk0'/>
Jul 25 15:34:34 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </disk>
Jul 25 15:34:34 user nova-compute[70869]:     <disk type='file' device='cdrom'>
Jul 25 15:34:34 user nova-compute[70869]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 15:34:34 user nova-compute[70869]:       <source file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.config' index='1'/>
Jul 25 15:34:34 user nova-compute[70869]:       <backingStore/>
Jul 25 15:34:34 user nova-compute[70869]:       <target dev='hda' bus='ide'/>
Jul 25 15:34:34 user nova-compute[70869]:       <readonly/>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='ide0-0-0'/>
Jul 25 15:34:34 user nova-compute[70869]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </disk>
Jul 25 15:34:34 user nova-compute[70869]:     <controller type='usb' index='0' model='none'>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='usb'/>
Jul 25 15:34:34 user nova-compute[70869]:     </controller>
Jul 25 15:34:34 user nova-compute[70869]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='pci.0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </controller>
Jul 25 15:34:34 user nova-compute[70869]:     <controller type='ide' index='0'>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='ide'/>
Jul 25 15:34:34 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 15:34:34 user nova-compute[70869]:     </controller>
Jul 25 15:34:34 user nova-compute[70869]:     <interface type='ethernet'>
Jul 25 15:34:34 user nova-compute[70869]:       <mac address='fa:16:3e:cc:c8:d3'/>
Jul 25 15:34:34 user nova-compute[70869]:       <target dev='tap9911ada1-3a'/>
Jul 25 15:34:34 user nova-compute[70869]:       <model type='virtio'/>
Jul 25 15:34:34 user nova-compute[70869]:       <mtu size='1442'/>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='net0'/>
Jul 25 15:34:34 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </interface>
Jul 25 15:34:34 user nova-compute[70869]:     <serial type='pty'>
Jul 25 15:34:34 user nova-compute[70869]:       <source path='/dev/pts/8'/>
Jul 25 15:34:34 user nova-compute[70869]:       <log file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log' append='off'/>
Jul 25 15:34:34 user nova-compute[70869]:       <target type='isa-serial' port='0'>
Jul 25 15:34:34 user nova-compute[70869]:         <model name='isa-serial'/>
Jul 25 15:34:34 user nova-compute[70869]:       </target>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='serial0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </serial>
Jul 25 15:34:34 user nova-compute[70869]:     <console type='pty' tty='/dev/pts/8'>
Jul 25 15:34:34 user nova-compute[70869]:       <source path='/dev/pts/8'/>
Jul 25 15:34:34 user nova-compute[70869]:       <log file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log' append='off'/>
Jul 25 15:34:34 user nova-compute[70869]:       <target type='serial' port='0'/>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='serial0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </console>
Jul 25 15:34:34 user nova-compute[70869]:     <input type='mouse' bus='ps2'>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='input0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </input>
Jul 25 15:34:34 user nova-compute[70869]:     <input type='keyboard' bus='ps2'>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='input1'/>
Jul 25 15:34:34 user nova-compute[70869]:     </input>
Jul 25 15:34:34 user nova-compute[70869]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 25 15:34:34 user nova-compute[70869]:       <listen type='address' address='0.0.0.0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </graphics>
Jul 25 15:34:34 user nova-compute[70869]:     <audio id='1' type='none'/>
Jul 25 15:34:34 user nova-compute[70869]:     <video>
Jul 25 15:34:34 user nova-compute[70869]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='video0'/>
Jul 25 15:34:34 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </video>
Jul 25 15:34:34 user nova-compute[70869]:     <memballoon model='virtio'>
Jul 25 15:34:34 user nova-compute[70869]:       <stats period='10'/>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='balloon0'/>
Jul 25 15:34:34 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </memballoon>
Jul 25 15:34:34 user nova-compute[70869]:     <rng model='virtio'>
Jul 25 15:34:34 user nova-compute[70869]:       <backend model='random'>/dev/urandom</backend>
Jul 25 15:34:34 user nova-compute[70869]:       <alias name='rng0'/>
Jul 25 15:34:34 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 15:34:34 user nova-compute[70869]:     </rng>
Jul 25 15:34:34 user nova-compute[70869]:   </devices>
Jul 25 15:34:34 user nova-compute[70869]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 15:34:34 user nova-compute[70869]:     <label>libvirt-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</label>
Jul 25 15:34:34 user nova-compute[70869]:     <imagelabel>libvirt-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</imagelabel>
Jul 25 15:34:34 user nova-compute[70869]:   </seclabel>
Jul 25 15:34:34 user nova-compute[70869]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 15:34:34 user nova-compute[70869]:     <label>+64055:+108</label>
Jul 25 15:34:34 user nova-compute[70869]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 15:34:34 user nova-compute[70869]:   </seclabel>
Jul 25 15:34:34 user nova-compute[70869]: </domain>
Jul 25 15:34:34 user nova-compute[70869]:  {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 15:34:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Successfully detached device tape2a9ec6f-08 from instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff from the live domain config.
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881880919',id=9,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCnjUFS4GVvp1uY+i4MWSiPTipwFlk1fAmhL09GyrCSrjDVSQvYyS8MW2Ahfcl4CTdExtioOorFgZMog5w/XI0cedHfxpHuJtENl/M1IXTFU2CPc7Y1H/+dLskGA8s5g==',key_name='tempest-keypair-1573765752',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e5e728d1bdf4015b917d1d77e7a2e75',ramdisk_id='',reservation_id='r-enxwzktb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1524187401',owner_user_name='tempest-TaggedAttachmentsTest-1524187401-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21c066cfdbd498a9ac779e762799d2b',uuid=b6c9b6d1-5006-4160-a559-ea5c46e7c4ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converting VIF {"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG os_vif [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:34 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:34:34 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=6440MB free_disk=25.66632080078125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2a9ec6f-08, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:34 user nova-compute[70869]: INFO os_vif [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08')
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:34:34 user nova-compute[70869]:   <nova:package version="0.0.0"/>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:name>tempest-device-tagging-server-1881880919</nova:name>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:creationTime>2023-07-25 15:34:34</nova:creationTime>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:flavor name="m1.tiny">
Jul 25 15:34:34 user nova-compute[70869]:     <nova:memory>512</nova:memory>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:disk>1</nova:disk>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:swap>0</nova:swap>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:vcpus>1</nova:vcpus>
Jul 25 15:34:34 user nova-compute[70869]:   </nova:flavor>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:owner>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:user uuid="f21c066cfdbd498a9ac779e762799d2b">tempest-TaggedAttachmentsTest-1524187401-project-member</nova:user>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:project uuid="5e5e728d1bdf4015b917d1d77e7a2e75">tempest-TaggedAttachmentsTest-1524187401</nova:project>
Jul 25 15:34:34 user nova-compute[70869]:   </nova:owner>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:34:34 user nova-compute[70869]:   <nova:ports>
Jul 25 15:34:34 user nova-compute[70869]:     <nova:port uuid="9911ada1-3a21-4e33-be13-d786a18560fd">
Jul 25 15:34:34 user nova-compute[70869]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:34:34 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:34 user nova-compute[70869]:   </nova:ports>
Jul 25 15:34:34 user nova-compute[70869]: </nova:instance>
Jul 25 15:34:34 user nova-compute[70869]:  {{(pid=70869) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fa170559-5228-448f-acea-c5b816a22631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 08fa2836-717a-4893-8969-fcab677935a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3a84f092-352e-4039-8dcb-bd4578458765 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance dd06411a-f6dc-4e4a-894f-517410bda71d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance da94f076-89f8-40be-b8bb-f4f8a73953ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 1093381e-c322-4ed0-91cb-1a8e956f8dfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3b38a39b-5ad8-4341-b132-597b8ab6a849 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.614s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] <== connect_volume: return (1617ms) {'type': 'block', 'scsi_wwn': '26330633635613565', 'path': '/dev/sdi'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330633635613565', 'path': '/dev/sdi'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.objects.instance [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lazy-loading 'flavor' on Instance uuid 3a84f092-352e-4039-8dcb-bd4578458765 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:34 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Took 1.30 seconds to deallocate network for instance.
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-61785896-3a1b-4f1c-b66b-dfa6427c9a63 req-95fe5e90-bf3b-4bfa-8c28-18895ce4e641 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received event network-vif-plugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-61785896-3a1b-4f1c-b66b-dfa6427c9a63 req-95fe5e90-bf3b-4bfa-8c28-18895ce4e641 service nova] Acquiring lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-61785896-3a1b-4f1c-b66b-dfa6427c9a63 req-95fe5e90-bf3b-4bfa-8c28-18895ce4e641 service nova] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-61785896-3a1b-4f1c-b66b-dfa6427c9a63 req-95fe5e90-bf3b-4bfa-8c28-18895ce4e641 service nova] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-61785896-3a1b-4f1c-b66b-dfa6427c9a63 req-95fe5e90-bf3b-4bfa-8c28-18895ce4e641 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] No waiting events found dispatching network-vif-plugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:34 user nova-compute[70869]: WARNING nova.compute.manager [req-61785896-3a1b-4f1c-b66b-dfa6427c9a63 req-95fe5e90-bf3b-4bfa-8c28-18895ce4e641 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received unexpected event network-vif-plugged-99306340-f2ac-483c-99d4-bf4a0fd05c25 for instance with vm_state active and task_state deleting.
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-61785896-3a1b-4f1c-b66b-dfa6427c9a63 req-95fe5e90-bf3b-4bfa-8c28-18895ce4e641 service nova] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Received event network-vif-deleted-99306340-f2ac-483c-99d4-bf4a0fd05c25 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.709s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.144s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-deleted-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:34 user nova-compute[70869]: INFO nova.compute.manager [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Neutron deleted interface e2a9ec6f-08ed-4116-b0e2-c39099b07f7b; detaching it from the instance and deleting it from the info cache
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.network.neutron [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updating instance_info_cache with network_info: [{"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquired lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.objects.instance [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] Lazy-loading 'system_metadata' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.objects.instance [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] Lazy-loading 'flavor' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881880919',id=9,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCnjUFS4GVvp1uY+i4MWSiPTipwFlk1fAmhL09GyrCSrjDVSQvYyS8MW2Ahfcl4CTdExtioOorFgZMog5w/XI0cedHfxpHuJtENl/M1IXTFU2CPc7Y1H/+dLskGA8s5g==',key_name='tempest-keypair-1573765752',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e5e728d1bdf4015b917d1d77e7a2e75',ramdisk_id='',reservation_id='r-enxwzktb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1524187401',owner_user_name='tempest-TaggedAttachmentsTest-1524187401-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21c066cfdbd498a9ac779e762799d2b',uuid=b6c9b6d1-5006-4160-a559-ea5c46e7c4ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] Converting VIF {"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface> {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 25 15:34:35 user nova-compute[70869]:   <name>instance-00000009</name>
Jul 25 15:34:35 user nova-compute[70869]:   <uuid>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</uuid>
Jul 25 15:34:35 user nova-compute[70869]:   <metadata>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:34:35 user nova-compute[70869]:   <nova:package version="0.0.0"/>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:name>tempest-device-tagging-server-1881880919</nova:name>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:creationTime>2023-07-25 15:34:34</nova:creationTime>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:flavor name="m1.tiny">
Jul 25 15:34:35 user nova-compute[70869]:     <nova:memory>512</nova:memory>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:disk>1</nova:disk>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:swap>0</nova:swap>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:vcpus>1</nova:vcpus>
Jul 25 15:34:35 user nova-compute[70869]:   </nova:flavor>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:owner>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:user uuid="f21c066cfdbd498a9ac779e762799d2b">tempest-TaggedAttachmentsTest-1524187401-project-member</nova:user>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:project uuid="5e5e728d1bdf4015b917d1d77e7a2e75">tempest-TaggedAttachmentsTest-1524187401</nova:project>
Jul 25 15:34:35 user nova-compute[70869]:   </nova:owner>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:ports>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:port uuid="9911ada1-3a21-4e33-be13-d786a18560fd">
Jul 25 15:34:35 user nova-compute[70869]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:34:35 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:35 user nova-compute[70869]:   </nova:ports>
Jul 25 15:34:35 user nova-compute[70869]: </nova:instance>
Jul 25 15:34:35 user nova-compute[70869]:   </metadata>
Jul 25 15:34:35 user nova-compute[70869]:   <memory unit='KiB'>524288</memory>
Jul 25 15:34:35 user nova-compute[70869]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 15:34:35 user nova-compute[70869]:   <vcpu placement='static'>1</vcpu>
Jul 25 15:34:35 user nova-compute[70869]:   <resource>
Jul 25 15:34:35 user nova-compute[70869]:     <partition>/machine</partition>
Jul 25 15:34:35 user nova-compute[70869]:   </resource>
Jul 25 15:34:35 user nova-compute[70869]:   <sysinfo type='smbios'>
Jul 25 15:34:35 user nova-compute[70869]:     <system>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='version'>0.0.0</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='serial'>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='uuid'>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='family'>Virtual Machine</entry>
Jul 25 15:34:35 user nova-compute[70869]:     </system>
Jul 25 15:34:35 user nova-compute[70869]:   </sysinfo>
Jul 25 15:34:35 user nova-compute[70869]:   <os>
Jul 25 15:34:35 user nova-compute[70869]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 15:34:35 user nova-compute[70869]:     <boot dev='hd'/>
Jul 25 15:34:35 user nova-compute[70869]:     <smbios mode='sysinfo'/>
Jul 25 15:34:35 user nova-compute[70869]:   </os>
Jul 25 15:34:35 user nova-compute[70869]:   <features>
Jul 25 15:34:35 user nova-compute[70869]:     <acpi/>
Jul 25 15:34:35 user nova-compute[70869]:     <apic/>
Jul 25 15:34:35 user nova-compute[70869]:     <vmcoreinfo state='on'/>
Jul 25 15:34:35 user nova-compute[70869]:   </features>
Jul 25 15:34:35 user nova-compute[70869]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 15:34:35 user nova-compute[70869]:     <model fallback='forbid'>Nehalem</model>
Jul 25 15:34:35 user nova-compute[70869]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 15:34:35 user nova-compute[70869]:     <feature policy='require' name='vme'/>
Jul 25 15:34:35 user nova-compute[70869]:     <feature policy='require' name='x2apic'/>
Jul 25 15:34:35 user nova-compute[70869]:     <feature policy='require' name='hypervisor'/>
Jul 25 15:34:35 user nova-compute[70869]:   </cpu>
Jul 25 15:34:35 user nova-compute[70869]:   <clock offset='utc'>
Jul 25 15:34:35 user nova-compute[70869]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 15:34:35 user nova-compute[70869]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 15:34:35 user nova-compute[70869]:     <timer name='hpet' present='no'/>
Jul 25 15:34:35 user nova-compute[70869]:   </clock>
Jul 25 15:34:35 user nova-compute[70869]:   <on_poweroff>destroy</on_poweroff>
Jul 25 15:34:35 user nova-compute[70869]:   <on_reboot>restart</on_reboot>
Jul 25 15:34:35 user nova-compute[70869]:   <on_crash>destroy</on_crash>
Jul 25 15:34:35 user nova-compute[70869]:   <devices>
Jul 25 15:34:35 user nova-compute[70869]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 15:34:35 user nova-compute[70869]:     <disk type='file' device='disk'>
Jul 25 15:34:35 user nova-compute[70869]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 15:34:35 user nova-compute[70869]:       <source file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk' index='2'/>
Jul 25 15:34:35 user nova-compute[70869]:       <backingStore type='file' index='3'>
Jul 25 15:34:35 user nova-compute[70869]:         <format type='raw'/>
Jul 25 15:34:35 user nova-compute[70869]:         <source file='/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319'/>
Jul 25 15:34:35 user nova-compute[70869]:         <backingStore/>
Jul 25 15:34:35 user nova-compute[70869]:       </backingStore>
Jul 25 15:34:35 user nova-compute[70869]:       <target dev='vda' bus='virtio'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='virtio-disk0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </disk>
Jul 25 15:34:35 user nova-compute[70869]:     <disk type='file' device='cdrom'>
Jul 25 15:34:35 user nova-compute[70869]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 15:34:35 user nova-compute[70869]:       <source file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.config' index='1'/>
Jul 25 15:34:35 user nova-compute[70869]:       <backingStore/>
Jul 25 15:34:35 user nova-compute[70869]:       <target dev='hda' bus='ide'/>
Jul 25 15:34:35 user nova-compute[70869]:       <readonly/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='ide0-0-0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </disk>
Jul 25 15:34:35 user nova-compute[70869]:     <controller type='usb' index='0' model='none'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='usb'/>
Jul 25 15:34:35 user nova-compute[70869]:     </controller>
Jul 25 15:34:35 user nova-compute[70869]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='pci.0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </controller>
Jul 25 15:34:35 user nova-compute[70869]:     <controller type='ide' index='0'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='ide'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 15:34:35 user nova-compute[70869]:     </controller>
Jul 25 15:34:35 user nova-compute[70869]:     <interface type='ethernet'>
Jul 25 15:34:35 user nova-compute[70869]:       <mac address='fa:16:3e:cc:c8:d3'/>
Jul 25 15:34:35 user nova-compute[70869]:       <target dev='tap9911ada1-3a'/>
Jul 25 15:34:35 user nova-compute[70869]:       <model type='virtio'/>
Jul 25 15:34:35 user nova-compute[70869]:       <mtu size='1442'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='net0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </interface>
Jul 25 15:34:35 user nova-compute[70869]:     <serial type='pty'>
Jul 25 15:34:35 user nova-compute[70869]:       <source path='/dev/pts/8'/>
Jul 25 15:34:35 user nova-compute[70869]:       <log file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log' append='off'/>
Jul 25 15:34:35 user nova-compute[70869]:       <target type='isa-serial' port='0'>
Jul 25 15:34:35 user nova-compute[70869]:         <model name='isa-serial'/>
Jul 25 15:34:35 user nova-compute[70869]:       </target>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='serial0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </serial>
Jul 25 15:34:35 user nova-compute[70869]:     <console type='pty' tty='/dev/pts/8'>
Jul 25 15:34:35 user nova-compute[70869]:       <source path='/dev/pts/8'/>
Jul 25 15:34:35 user nova-compute[70869]:       <log file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log' append='off'/>
Jul 25 15:34:35 user nova-compute[70869]:       <target type='serial' port='0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='serial0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </console>
Jul 25 15:34:35 user nova-compute[70869]:     <input type='mouse' bus='ps2'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='input0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </input>
Jul 25 15:34:35 user nova-compute[70869]:     <input type='keyboard' bus='ps2'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='input1'/>
Jul 25 15:34:35 user nova-compute[70869]:     </input>
Jul 25 15:34:35 user nova-compute[70869]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 25 15:34:35 user nova-compute[70869]:       <listen type='address' address='0.0.0.0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </graphics>
Jul 25 15:34:35 user nova-compute[70869]:     <audio id='1' type='none'/>
Jul 25 15:34:35 user nova-compute[70869]:     <video>
Jul 25 15:34:35 user nova-compute[70869]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='video0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </video>
Jul 25 15:34:35 user nova-compute[70869]:     <memballoon model='virtio'>
Jul 25 15:34:35 user nova-compute[70869]:       <stats period='10'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='balloon0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </memballoon>
Jul 25 15:34:35 user nova-compute[70869]:     <rng model='virtio'>
Jul 25 15:34:35 user nova-compute[70869]:       <backend model='random'>/dev/urandom</backend>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='rng0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </rng>
Jul 25 15:34:35 user nova-compute[70869]:   </devices>
Jul 25 15:34:35 user nova-compute[70869]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 15:34:35 user nova-compute[70869]:     <label>libvirt-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</label>
Jul 25 15:34:35 user nova-compute[70869]:     <imagelabel>libvirt-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</imagelabel>
Jul 25 15:34:35 user nova-compute[70869]:   </seclabel>
Jul 25 15:34:35 user nova-compute[70869]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 15:34:35 user nova-compute[70869]:     <label>+64055:+108</label>
Jul 25 15:34:35 user nova-compute[70869]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 15:34:35 user nova-compute[70869]:   </seclabel>
Jul 25 15:34:35 user nova-compute[70869]: </domain>
Jul 25 15:34:35 user nova-compute[70869]:  {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface> {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:72:1c:6b"/><model type="virtio"/><mtu size="1442"/><target dev="tape2a9ec6f-08"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 25 15:34:35 user nova-compute[70869]:   <name>instance-00000009</name>
Jul 25 15:34:35 user nova-compute[70869]:   <uuid>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</uuid>
Jul 25 15:34:35 user nova-compute[70869]:   <metadata>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:34:35 user nova-compute[70869]:   <nova:package version="0.0.0"/>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:name>tempest-device-tagging-server-1881880919</nova:name>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:creationTime>2023-07-25 15:34:34</nova:creationTime>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:flavor name="m1.tiny">
Jul 25 15:34:35 user nova-compute[70869]:     <nova:memory>512</nova:memory>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:disk>1</nova:disk>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:swap>0</nova:swap>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:vcpus>1</nova:vcpus>
Jul 25 15:34:35 user nova-compute[70869]:   </nova:flavor>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:owner>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:user uuid="f21c066cfdbd498a9ac779e762799d2b">tempest-TaggedAttachmentsTest-1524187401-project-member</nova:user>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:project uuid="5e5e728d1bdf4015b917d1d77e7a2e75">tempest-TaggedAttachmentsTest-1524187401</nova:project>
Jul 25 15:34:35 user nova-compute[70869]:   </nova:owner>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:ports>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:port uuid="9911ada1-3a21-4e33-be13-d786a18560fd">
Jul 25 15:34:35 user nova-compute[70869]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:34:35 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:35 user nova-compute[70869]:   </nova:ports>
Jul 25 15:34:35 user nova-compute[70869]: </nova:instance>
Jul 25 15:34:35 user nova-compute[70869]:   </metadata>
Jul 25 15:34:35 user nova-compute[70869]:   <memory unit='KiB'>524288</memory>
Jul 25 15:34:35 user nova-compute[70869]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 25 15:34:35 user nova-compute[70869]:   <vcpu placement='static'>1</vcpu>
Jul 25 15:34:35 user nova-compute[70869]:   <resource>
Jul 25 15:34:35 user nova-compute[70869]:     <partition>/machine</partition>
Jul 25 15:34:35 user nova-compute[70869]:   </resource>
Jul 25 15:34:35 user nova-compute[70869]:   <sysinfo type='smbios'>
Jul 25 15:34:35 user nova-compute[70869]:     <system>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='product'>OpenStack Nova</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='version'>0.0.0</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='serial'>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='uuid'>b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</entry>
Jul 25 15:34:35 user nova-compute[70869]:       <entry name='family'>Virtual Machine</entry>
Jul 25 15:34:35 user nova-compute[70869]:     </system>
Jul 25 15:34:35 user nova-compute[70869]:   </sysinfo>
Jul 25 15:34:35 user nova-compute[70869]:   <os>
Jul 25 15:34:35 user nova-compute[70869]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 25 15:34:35 user nova-compute[70869]:     <boot dev='hd'/>
Jul 25 15:34:35 user nova-compute[70869]:     <smbios mode='sysinfo'/>
Jul 25 15:34:35 user nova-compute[70869]:   </os>
Jul 25 15:34:35 user nova-compute[70869]:   <features>
Jul 25 15:34:35 user nova-compute[70869]:     <acpi/>
Jul 25 15:34:35 user nova-compute[70869]:     <apic/>
Jul 25 15:34:35 user nova-compute[70869]:     <vmcoreinfo state='on'/>
Jul 25 15:34:35 user nova-compute[70869]:   </features>
Jul 25 15:34:35 user nova-compute[70869]:   <cpu mode='custom' match='exact' check='full'>
Jul 25 15:34:35 user nova-compute[70869]:     <model fallback='forbid'>Nehalem</model>
Jul 25 15:34:35 user nova-compute[70869]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 25 15:34:35 user nova-compute[70869]:     <feature policy='require' name='vme'/>
Jul 25 15:34:35 user nova-compute[70869]:     <feature policy='require' name='x2apic'/>
Jul 25 15:34:35 user nova-compute[70869]:     <feature policy='require' name='hypervisor'/>
Jul 25 15:34:35 user nova-compute[70869]:   </cpu>
Jul 25 15:34:35 user nova-compute[70869]:   <clock offset='utc'>
Jul 25 15:34:35 user nova-compute[70869]:     <timer name='pit' tickpolicy='delay'/>
Jul 25 15:34:35 user nova-compute[70869]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 25 15:34:35 user nova-compute[70869]:     <timer name='hpet' present='no'/>
Jul 25 15:34:35 user nova-compute[70869]:   </clock>
Jul 25 15:34:35 user nova-compute[70869]:   <on_poweroff>destroy</on_poweroff>
Jul 25 15:34:35 user nova-compute[70869]:   <on_reboot>restart</on_reboot>
Jul 25 15:34:35 user nova-compute[70869]:   <on_crash>destroy</on_crash>
Jul 25 15:34:35 user nova-compute[70869]:   <devices>
Jul 25 15:34:35 user nova-compute[70869]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 25 15:34:35 user nova-compute[70869]:     <disk type='file' device='disk'>
Jul 25 15:34:35 user nova-compute[70869]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 25 15:34:35 user nova-compute[70869]:       <source file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk' index='2'/>
Jul 25 15:34:35 user nova-compute[70869]:       <backingStore type='file' index='3'>
Jul 25 15:34:35 user nova-compute[70869]:         <format type='raw'/>
Jul 25 15:34:35 user nova-compute[70869]:         <source file='/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319'/>
Jul 25 15:34:35 user nova-compute[70869]:         <backingStore/>
Jul 25 15:34:35 user nova-compute[70869]:       </backingStore>
Jul 25 15:34:35 user nova-compute[70869]:       <target dev='vda' bus='virtio'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='virtio-disk0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </disk>
Jul 25 15:34:35 user nova-compute[70869]:     <disk type='file' device='cdrom'>
Jul 25 15:34:35 user nova-compute[70869]:       <driver name='qemu' type='raw' cache='none'/>
Jul 25 15:34:35 user nova-compute[70869]:       <source file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/disk.config' index='1'/>
Jul 25 15:34:35 user nova-compute[70869]:       <backingStore/>
Jul 25 15:34:35 user nova-compute[70869]:       <target dev='hda' bus='ide'/>
Jul 25 15:34:35 user nova-compute[70869]:       <readonly/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='ide0-0-0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </disk>
Jul 25 15:34:35 user nova-compute[70869]:     <controller type='usb' index='0' model='none'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='usb'/>
Jul 25 15:34:35 user nova-compute[70869]:     </controller>
Jul 25 15:34:35 user nova-compute[70869]:     <controller type='pci' index='0' model='pci-root'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='pci.0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </controller>
Jul 25 15:34:35 user nova-compute[70869]:     <controller type='ide' index='0'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='ide'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 25 15:34:35 user nova-compute[70869]:     </controller>
Jul 25 15:34:35 user nova-compute[70869]:     <interface type='ethernet'>
Jul 25 15:34:35 user nova-compute[70869]:       <mac address='fa:16:3e:cc:c8:d3'/>
Jul 25 15:34:35 user nova-compute[70869]:       <target dev='tap9911ada1-3a'/>
Jul 25 15:34:35 user nova-compute[70869]:       <model type='virtio'/>
Jul 25 15:34:35 user nova-compute[70869]:       <mtu size='1442'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='net0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </interface>
Jul 25 15:34:35 user nova-compute[70869]:     <serial type='pty'>
Jul 25 15:34:35 user nova-compute[70869]:       <source path='/dev/pts/8'/>
Jul 25 15:34:35 user nova-compute[70869]:       <log file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log' append='off'/>
Jul 25 15:34:35 user nova-compute[70869]:       <target type='isa-serial' port='0'>
Jul 25 15:34:35 user nova-compute[70869]:         <model name='isa-serial'/>
Jul 25 15:34:35 user nova-compute[70869]:       </target>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='serial0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </serial>
Jul 25 15:34:35 user nova-compute[70869]:     <console type='pty' tty='/dev/pts/8'>
Jul 25 15:34:35 user nova-compute[70869]:       <source path='/dev/pts/8'/>
Jul 25 15:34:35 user nova-compute[70869]:       <log file='/opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff/console.log' append='off'/>
Jul 25 15:34:35 user nova-compute[70869]:       <target type='serial' port='0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='serial0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </console>
Jul 25 15:34:35 user nova-compute[70869]:     <input type='mouse' bus='ps2'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='input0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </input>
Jul 25 15:34:35 user nova-compute[70869]:     <input type='keyboard' bus='ps2'>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='input1'/>
Jul 25 15:34:35 user nova-compute[70869]:     </input>
Jul 25 15:34:35 user nova-compute[70869]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 25 15:34:35 user nova-compute[70869]:       <listen type='address' address='0.0.0.0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </graphics>
Jul 25 15:34:35 user nova-compute[70869]:     <audio id='1' type='none'/>
Jul 25 15:34:35 user nova-compute[70869]:     <video>
Jul 25 15:34:35 user nova-compute[70869]:       <model type='virtio' heads='1' primary='yes'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='video0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </video>
Jul 25 15:34:35 user nova-compute[70869]:     <memballoon model='virtio'>
Jul 25 15:34:35 user nova-compute[70869]:       <stats period='10'/>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='balloon0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </memballoon>
Jul 25 15:34:35 user nova-compute[70869]:     <rng model='virtio'>
Jul 25 15:34:35 user nova-compute[70869]:       <backend model='random'>/dev/urandom</backend>
Jul 25 15:34:35 user nova-compute[70869]:       <alias name='rng0'/>
Jul 25 15:34:35 user nova-compute[70869]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 25 15:34:35 user nova-compute[70869]:     </rng>
Jul 25 15:34:35 user nova-compute[70869]:   </devices>
Jul 25 15:34:35 user nova-compute[70869]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 25 15:34:35 user nova-compute[70869]:     <label>libvirt-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</label>
Jul 25 15:34:35 user nova-compute[70869]:     <imagelabel>libvirt-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff</imagelabel>
Jul 25 15:34:35 user nova-compute[70869]:   </seclabel>
Jul 25 15:34:35 user nova-compute[70869]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 25 15:34:35 user nova-compute[70869]:     <label>+64055:+108</label>
Jul 25 15:34:35 user nova-compute[70869]:     <imagelabel>+64055:+108</imagelabel>
Jul 25 15:34:35 user nova-compute[70869]:   </seclabel>
Jul 25 15:34:35 user nova-compute[70869]: </domain>
Jul 25 15:34:35 user nova-compute[70869]:  {{(pid=70869) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 25 15:34:35 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Detaching interface fa:16:3e:72:1c:6b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tape2a9ec6f-08' not found.
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881880919',id=9,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCnjUFS4GVvp1uY+i4MWSiPTipwFlk1fAmhL09GyrCSrjDVSQvYyS8MW2Ahfcl4CTdExtioOorFgZMog5w/XI0cedHfxpHuJtENl/M1IXTFU2CPc7Y1H/+dLskGA8s5g==',key_name='tempest-keypair-1573765752',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e5e728d1bdf4015b917d1d77e7a2e75',ramdisk_id='',reservation_id='r-enxwzktb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1524187401',owner_user_name='tempest-TaggedAttachmentsTest-1524187401-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21c066cfdbd498a9ac779e762799d2b',uuid=b6c9b6d1-5006-4160-a559-ea5c46e7c4ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] Converting VIF {"id": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "address": "fa:16:3e:72:1c:6b", "network": {"id": "22364f05-419a-4a30-b280-012ef35d4af4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-711542898", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2a9ec6f-08", "ovs_interfaceid": "e2a9ec6f-08ed-4116-b0e2-c39099b07f7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG os_vif [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2a9ec6f-08, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:34:35 user nova-compute[70869]: INFO os_vif [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1c:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2a9ec6f-08ed-4116-b0e2-c39099b07f7b,network=Network(22364f05-419a-4a30-b280-012ef35d4af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2a9ec6f-08')
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [req-a2ae02c8-a6ac-48cb-be09-5a43602f70ce req-a2500b80-08e9-4f52-96f4-57cd91308f89 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:34:35 user nova-compute[70869]:   <nova:package version="0.0.0"/>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:name>tempest-device-tagging-server-1881880919</nova:name>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:creationTime>2023-07-25 15:34:35</nova:creationTime>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:flavor name="m1.tiny">
Jul 25 15:34:35 user nova-compute[70869]:     <nova:memory>512</nova:memory>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:disk>1</nova:disk>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:swap>0</nova:swap>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:vcpus>1</nova:vcpus>
Jul 25 15:34:35 user nova-compute[70869]:   </nova:flavor>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:owner>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:user uuid="f21c066cfdbd498a9ac779e762799d2b">tempest-TaggedAttachmentsTest-1524187401-project-member</nova:user>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:project uuid="5e5e728d1bdf4015b917d1d77e7a2e75">tempest-TaggedAttachmentsTest-1524187401</nova:project>
Jul 25 15:34:35 user nova-compute[70869]:   </nova:owner>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:34:35 user nova-compute[70869]:   <nova:ports>
Jul 25 15:34:35 user nova-compute[70869]:     <nova:port uuid="9911ada1-3a21-4e33-be13-d786a18560fd">
Jul 25 15:34:35 user nova-compute[70869]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:34:35 user nova-compute[70869]:     </nova:port>
Jul 25 15:34:35 user nova-compute[70869]:   </nova:ports>
Jul 25 15:34:35 user nova-compute[70869]: </nova:instance>
Jul 25 15:34:35 user nova-compute[70869]:  {{(pid=70869) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 167772160 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:35 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Deleted allocations for instance 3927367a-ad7c-4ad7-9812-4b0199e9a9a1
Jul 25 15:34:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b39b5fde-41d8-429b-841d-e5a93f0eb511 tempest-AttachSCSIVolumeTestJSON-221261173 tempest-AttachSCSIVolumeTestJSON-221261173-project-member] Lock "3927367a-ad7c-4ad7-9812-4b0199e9a9a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.457s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updating instance_info_cache with network_info: [{"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Releasing lock "refresh_cache-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dfb6b7ab-fda9-49b6-bbe0-63d00cb18b0b tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "interface-b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.545s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:34:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 351272960 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-11b8a420-4e2b-4795-9a40-06dad2b3e566 req-c606bcb7-0273-4fb5-8e5c-7525fb421965 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-plugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-11b8a420-4e2b-4795-9a40-06dad2b3e566 req-c606bcb7-0273-4fb5-8e5c-7525fb421965 service nova] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-11b8a420-4e2b-4795-9a40-06dad2b3e566 req-c606bcb7-0273-4fb5-8e5c-7525fb421965 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-11b8a420-4e2b-4795-9a40-06dad2b3e566 req-c606bcb7-0273-4fb5-8e5c-7525fb421965 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-11b8a420-4e2b-4795-9a40-06dad2b3e566 req-c606bcb7-0273-4fb5-8e5c-7525fb421965 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] No waiting events found dispatching network-vif-plugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:36 user nova-compute[70869]: WARNING nova.compute.manager [req-11b8a420-4e2b-4795-9a40-06dad2b3e566 req-c606bcb7-0273-4fb5-8e5c-7525fb421965 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received unexpected event network-vif-plugged-e2a9ec6f-08ed-4116-b0e2-c39099b07f7b for instance with vm_state active and task_state None.
Jul 25 15:34:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 563085312 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 763363328 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 946864128 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCrRewl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:38 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d872542d-4a52-4a18-9d20-ddb429460824]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:38 user nova-compute[70869]: No targets found.
Jul 25 15:34:38 user nova-compute[70869]: iSNS:
Jul 25 15:34:38 user nova-compute[70869]: No targets found.
Jul 25 15:34:38 user nova-compute[70869]: STATIC:
Jul 25 15:34:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f
Jul 25 15:34:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:34:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd
Jul 25 15:34:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491
Jul 25 15:34:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a
Jul 25 15:34:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:38 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:38 user nova-compute[70869]: No targets found.
Jul 25 15:34:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:38 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:38 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6bc016-71e2-4456-ac45-29e92e8371e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[64255d83-0d1d-4b67-a169-08a0867787f5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c23d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd'): ({'sdj'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Removing single pathed devices sdj {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd62341-dc57-418c-9720-f76a4a99f1a7]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b02e917-1f0e-457c-86c0-2f9f63ae472e]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Flushing IO for device /dev/sdj {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c565a-73e5-4653-ae76-1436f0ae6140]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.054s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[07349b89-8e0b-4951-99cf-1975d6fa1487]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] SCSI volumes sdj have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc0814a-9733-4b9a-91ec-77707d8b6646]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1077d265-aa63-4c1e-bbe2-243d52991cc6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260]
Jul 25 15:34:38 user nova-compute[70869]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c2e54b-4039-49ad-aae3-3ed04f9dcb79]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] <== disconnect_volume: return (342ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKweCBgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '3a84f092-352e-4039-8dcb-bd4578458765', 'attached_at': '', 'detached_at': '', 'volume_id': '71a63402-649d-4f1c-8016-303dff7eea8f', 'serial'} {{(pid=70869) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 25 15:34:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] swap_volume: removing Cinder connection for volume e4415034-90d6-4b57-b797-d80bb15563bd {{(pid=70869) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 25 15:34:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] swap_volume: Updating volume e4415034-90d6-4b57-b797-d80bb15563bd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "tKweCBgc", "auth_password": "tov398zWNASqCL", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "71a63402-649d-4f1c-8016-303dff7eea8f"}, "status": "reserved", "instance": "3a84f092-352e-4039-8dcb-bd4578458765", "attached_at": "", "detached_at": "", "volume_id": "71a63402-649d-4f1c-8016-303dff7eea8f", "serial": "71a63402-649d-4f1c-8016-303dff7eea8f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '71a63402-649d-4f1c-8016-303dff7eea8f', 'no_device': None, 'attachment_id': '2a7fea6e-9bcc-4c0b-b9d8-f2c0743355ab'} {{(pid=70869) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 25 15:34:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-377a065e-1514-4108-9c96-1c2ea8ffb431 tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "3a84f092-352e-4039-8dcb-bd4578458765" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.354s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "3a84f092-352e-4039-8dcb-bd4578458765" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG os_brick.utils [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c6ce0-0096-4dac-b740-f8c8821e4ff4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[415d7a4c-a6e8-4b11-9596-3139013e67e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[945e51f2-11ae-4f9f-a143-cfb23aedebc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3171b7-5743-49d8-9a58-63a4a98dd48c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:40 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:34:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e923aa-953f-43ed-845e-37f0ceb616cc]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:34:40 user nova-compute[70869]: DEBUG os_brick.utils [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:40 user nova-compute[70869]: INFO nova.compute.manager [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Swapping volume 71a63402-649d-4f1c-8016-303dff7eea8f for e4415034-90d6-4b57-b797-d80bb15563bd
Jul 25 15:34:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:34:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:34:43 user nova-compute[70869]: INFO nova.compute.claims [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Claim successful on node user
Jul 25 15:34:43 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:34:43 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:34:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:34:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:34:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:34:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:34:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:34:43 user nova-compute[70869]: INFO nova.virt.block_device [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Booting with blank volume at /dev/vda
Jul 25 15:34:43 user nova-compute[70869]: DEBUG nova.policy [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02dfa618b8fc4b06b5e396b7da9e8443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3735c3192f424a8abee7c1874609f005', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:34:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:44 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Successfully created port: f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Successfully updated port: f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquired lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d73260f-2aeb-4db5-b1a6-32e797c247b4 req-aebd4e6d-f167-4bee-979e-6dafb46981bd service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-changed-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d73260f-2aeb-4db5-b1a6-32e797c247b4 req-aebd4e6d-f167-4bee-979e-6dafb46981bd service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Refreshing instance network info cache due to event network-changed-f433efca-963a-44ce-99c2-b1c4488c564a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d73260f-2aeb-4db5-b1a6-32e797c247b4 req-aebd4e6d-f167-4bee-979e-6dafb46981bd service nova] Acquiring lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updating instance_info_cache with network_info: [{"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Releasing lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Instance network_info: |[{"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d73260f-2aeb-4db5-b1a6-32e797c247b4 req-aebd4e6d-f167-4bee-979e-6dafb46981bd service nova] Acquired lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-0d73260f-2aeb-4db5-b1a6-32e797c247b4 req-aebd4e6d-f167-4bee-979e-6dafb46981bd service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Refreshing network info cache for port f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-0d73260f-2aeb-4db5-b1a6-32e797c247b4 req-aebd4e6d-f167-4bee-979e-6dafb46981bd service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updated VIF entry in instance network info cache for port f433efca-963a-44ce-99c2-b1c4488c564a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:34:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-0d73260f-2aeb-4db5-b1a6-32e797c247b4 req-aebd4e6d-f167-4bee-979e-6dafb46981bd service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updating instance_info_cache with network_info: [{"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d73260f-2aeb-4db5-b1a6-32e797c247b4 req-aebd4e6d-f167-4bee-979e-6dafb46981bd service nova] Releasing lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCrRewl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a84f092-352e-4039-8dcb-bd4578458765', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4415034-90d6-4b57-b797-d80bb15563bd', 'serial': 'e4415034-90d6-4b57-b797-d80bb15563bd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKweCBgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '71a63402-649d-4f1c-8016-303dff7eea8f'}, 'status': 'reserved', 'instance': '3a84f092-352e-4039-8dcb-bd4578458765', 'attached_at': '', 'detached_at': '', 'volume_id': '71a63402-649d-4f1c-8016-303dff7eea8f', 'serial'} {{(pid=70869) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCrRewl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:48 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:48 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:48 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd96d20-b885-487b-94e2-90c28f753611]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:34:48 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3624d9-dd8d-4562-9178-0fdd1f43b02b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd] added
Jul 25 15:34:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d3e309-921e-4f9d-86c2-88b7eead2086]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1b46a6-e53c-4bd3-a7f5-2cf4a89eebf3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpCrRewl {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpCrRewl" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e816fc-4f35-4a0a-b0c1-5adcfc230129]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpCrRewl'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b60b26d-5129-425a-88af-84963018b44d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299273.1617372, 3927367a-ad7c-4ad7-9812-4b0199e9a9a1 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:34:48 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] VM Stopped (Lifecycle Event)
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a46b73-744f-4dd8-9696-77d5e15ca87b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7e1f4004-57c8-41f6-a846-357e8cc6d354 None None] [instance: 3927367a-ad7c-4ad7-9812-4b0199e9a9a1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f499aca-e206-4b53-ae30-515b7f5896f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260]
Jul 25 15:34:48 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98ffe14-f66e-4eaa-bcd2-f41a55ccd9af]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aa522a-20db-4ec3-88d3-b8b6de29b8c9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeca0c8-ece4-4492-bce8-882ac14debef]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:34:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCrRewl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG os_brick.utils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b0011f-4962-4fdf-9c6f-caf2dd24a237]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b4783-78b8-418e-8d4a-37a00920a909]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[931c83eb-9b55-462e-8a09-0871272abb2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[433944e5-2f84-4625-8bbb-0ff41c83f4bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:34:49 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:34:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a824ec-1a06-40b5-b8af-13e4d88ffd7c]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG os_brick.utils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updating existing volume attachment record: b4fd0aba-7f4a-4671-9fb8-cc933ae4c8fc {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23135323333663866', 'path': '/dev/sdj'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135323333663866', 'path': '/dev/sdj'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lazy-loading 'flavor' on Instance uuid 3a84f092-352e-4039-8dcb-bd4578458765 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 153092096 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 329252864 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-09079e4c-4f08-4d28-b7fd-4a86d1b9996b req-4bd4c7ce-1904-4ef7-ade0-62b055f5b846 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-changed-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-09079e4c-4f08-4d28-b7fd-4a86d1b9996b req-4bd4c7ce-1904-4ef7-ade0-62b055f5b846 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing instance network info cache due to event network-changed-870b555f-c0da-4f5e-bda0-b7fabc60bf16. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-09079e4c-4f08-4d28-b7fd-4a86d1b9996b req-4bd4c7ce-1904-4ef7-ade0-62b055f5b846 service nova] Acquiring lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-09079e4c-4f08-4d28-b7fd-4a86d1b9996b req-4bd4c7ce-1904-4ef7-ade0-62b055f5b846 service nova] Acquired lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG nova.network.neutron [req-09079e4c-4f08-4d28-b7fd-4a86d1b9996b req-4bd4c7ce-1904-4ef7-ade0-62b055f5b846 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Refreshing network info cache for port 870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 489684992 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 659554304 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG nova.network.neutron [req-09079e4c-4f08-4d28-b7fd-4a86d1b9996b req-4bd4c7ce-1904-4ef7-ade0-62b055f5b846 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updated VIF entry in instance network info cache for port 870b555f-c0da-4f5e-bda0-b7fabc60bf16. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG nova.network.neutron [req-09079e4c-4f08-4d28-b7fd-4a86d1b9996b req-4bd4c7ce-1904-4ef7-ade0-62b055f5b846 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [{"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-09079e4c-4f08-4d28-b7fd-4a86d1b9996b req-4bd4c7ce-1904-4ef7-ade0-62b055f5b846 service nova] Releasing lock "refresh_cache-dd06411a-f6dc-4e4a-894f-517410bda71d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 825229312 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 985661440 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-2cdfacd2-3ff7-43ab-976c-524168ccae3d req-0a43e7a7-12af-482d-ab10-1efff9dffba7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-changed-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-2cdfacd2-3ff7-43ab-976c-524168ccae3d req-0a43e7a7-12af-482d-ab10-1efff9dffba7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing instance network info cache due to event network-changed-f826bc9f-7358-4bac-9f9a-7fd060b7d350. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2cdfacd2-3ff7-43ab-976c-524168ccae3d req-0a43e7a7-12af-482d-ab10-1efff9dffba7 service nova] Acquiring lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2cdfacd2-3ff7-43ab-976c-524168ccae3d req-0a43e7a7-12af-482d-ab10-1efff9dffba7 service nova] Acquired lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG nova.network.neutron [req-2cdfacd2-3ff7-43ab-976c-524168ccae3d req-0a43e7a7-12af-482d-ab10-1efff9dffba7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Refreshing network info cache for port f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKweCBgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '71a63402-649d-4f1c-8016-303dff7eea8f'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:53 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef8e0e9-f1ac-489d-91f9-433460f9aa03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:53 user nova-compute[70869]: No targets found.
Jul 25 15:34:53 user nova-compute[70869]: iSNS:
Jul 25 15:34:53 user nova-compute[70869]: No targets found.
Jul 25 15:34:53 user nova-compute[70869]: STATIC:
Jul 25 15:34:53 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f
Jul 25 15:34:53 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:53 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:53 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:34:53 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:53 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:53 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:53 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:53 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:53 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:53 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:53 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:53 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:53 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:53 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:53 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd
Jul 25 15:34:53 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:53 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:53 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:53 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:53 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:53 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491
Jul 25 15:34:53 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:53 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:53 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a
Jul 25 15:34:53 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:53 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:53 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:53 user nova-compute[70869]: No targets found.
Jul 25 15:34:53 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:53 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:53 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee10424-5d8e-4a7f-a192-9324ed6ec7db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc483d8-cc16-432a-9f40-0cacc427f4de]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:53 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4430b3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f'): ({'sdi'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Removing single pathed devices sdi {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e559874a-51e6-408d-bf84-4b1679a43b25]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf1e7a1-6ddf-47fb-9edc-e252e6fa3516]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Flushing IO for device /dev/sdi {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccec5f4-6198-4fb6-856d-555acbccb5ec]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9625c3c2-f13e-4b3e-8f22-ccb29b3b7502]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] SCSI volumes sdi have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15a5e31-dcec-4403-b57c-2007415c876b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2416cfb5-fc4e-451d-af0b-b649de269ba4]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f, portal: 172.16.0.220,3260]
Jul 25 15:34:53 user nova-compute[70869]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:53 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a63402-649d-4f1c-8016-303dff7eea8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc3c252-562b-4027-818e-71c76e98c23b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] <== disconnect_volume: return (401ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCrRewl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '3a84f092-352e-4039-8dcb-bd4578458765', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4415034-90d6-4b57-b797-d80bb15563bd', 'serial'} {{(pid=70869) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] swap_volume: removing Cinder connection for volume 71a63402-649d-4f1c-8016-303dff7eea8f {{(pid=70869) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG nova.network.neutron [req-2cdfacd2-3ff7-43ab-976c-524168ccae3d req-0a43e7a7-12af-482d-ab10-1efff9dffba7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updated VIF entry in instance network info cache for port f826bc9f-7358-4bac-9f9a-7fd060b7d350. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG nova.network.neutron [req-2cdfacd2-3ff7-43ab-976c-524168ccae3d req-0a43e7a7-12af-482d-ab10-1efff9dffba7 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [{"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2cdfacd2-3ff7-43ab-976c-524168ccae3d req-0a43e7a7-12af-482d-ab10-1efff9dffba7 service nova] Releasing lock "refresh_cache-da94f076-89f8-40be-b8bb-f4f8a73953ae" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:54 user nova-compute[70869]: INFO nova.compute.manager [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Terminating instance
Jul 25 15:34:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-01f55d29-c836-4089-900e-891b352a7283 req-9c5f578f-7597-4e5f-aad8-7a5d7190948f service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-01f55d29-c836-4089-900e-891b352a7283 req-9c5f578f-7597-4e5f-aad8-7a5d7190948f service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-01f55d29-c836-4089-900e-891b352a7283 req-9c5f578f-7597-4e5f-aad8-7a5d7190948f service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-01f55d29-c836-4089-900e-891b352a7283 req-9c5f578f-7597-4e5f-aad8-7a5d7190948f service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-01f55d29-c836-4089-900e-891b352a7283 req-9c5f578f-7597-4e5f-aad8-7a5d7190948f service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-unplugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-01f55d29-c836-4089-900e-891b352a7283 req-9c5f578f-7597-4e5f-aad8-7a5d7190948f service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] swap_volume: Updating volume 71a63402-649d-4f1c-8016-303dff7eea8f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "mpCrRewl", "auth_password": "I3D58gExqh0YBR", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "e4415034-90d6-4b57-b797-d80bb15563bd"}, "status": "reserved", "instance": "3a84f092-352e-4039-8dcb-bd4578458765", "attached_at": "", "detached_at": "", "volume_id": "e4415034-90d6-4b57-b797-d80bb15563bd", "serial": "e4415034-90d6-4b57-b797-d80bb15563bd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e4415034-90d6-4b57-b797-d80bb15563bd', 'no_device': None, 'attachment_id': '28f31df2-2ffb-449b-ac03-9cbf9457395d'} {{(pid=70869) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4b3b370d-238e-4df8-a430-f6322ef6ff4d tempest-TestVolumeSwap-970474353 tempest-TestVolumeSwap-970474353-project-admin] Lock "3a84f092-352e-4039-8dcb-bd4578458765" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.512s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-6042baa3-f161-4bd2-95e4-b15a61d41ca7 req-5d32e58a-2582-4504-8aa9-72f6d189f185 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6042baa3-f161-4bd2-95e4-b15a61d41ca7 req-5d32e58a-2582-4504-8aa9-72f6d189f185 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6042baa3-f161-4bd2-95e4-b15a61d41ca7 req-5d32e58a-2582-4504-8aa9-72f6d189f185 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6042baa3-f161-4bd2-95e4-b15a61d41ca7 req-5d32e58a-2582-4504-8aa9-72f6d189f185 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-6042baa3-f161-4bd2-95e4-b15a61d41ca7 req-5d32e58a-2582-4504-8aa9-72f6d189f185 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-unplugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-6042baa3-f161-4bd2-95e4-b15a61d41ca7 req-5d32e58a-2582-4504-8aa9-72f6d189f185 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-unplugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:55 user nova-compute[70869]: WARNING nova.compute.manager [req-89960893-ac00-4adf-bcef-619bbb7ef13f req-e0b27222-7d23-437f-bf26-910367eed9ec service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-4bddee83-4e25-4ba3-b3d7-4547eeb347ce for instance with vm_state active and task_state deleting.
Jul 25 15:34:55 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Instance destroyed successfully.
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.objects.instance [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lazy-loading 'resources' on Instance uuid dd06411a-f6dc-4e4a-894f-517410bda71d {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:3e:3c,bridge_name='br-int',has_traffic_filtering=True,id=870b555f-c0da-4f5e-bda0-b7fabc60bf16,network=Network(95965bd0-a6d1-4725-ba2b-ef035c839102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870b555f-c0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:3e:3c,bridge_name='br-int',has_traffic_filtering=True,id=870b555f-c0da-4f5e-bda0-b7fabc60bf16,network=Network(95965bd0-a6d1-4725-ba2b-ef035c839102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870b555f-c0') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap870b555f-c0, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: INFO os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:3e:3c,bridge_name='br-int',has_traffic_filtering=True,id=870b555f-c0da-4f5e-bda0-b7fabc60bf16,network=Network(95965bd0-a6d1-4725-ba2b-ef035c839102),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870b555f-c0')
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=4bddee83-4e25-4ba3-b3d7-4547eeb347ce,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bddee83-4e') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=4bddee83-4e25-4ba3-b3d7-4547eeb347ce,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bddee83-4e') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bddee83-4e, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:56 user nova-compute[70869]: INFO nova.compute.manager [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Terminating instance
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: INFO os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=4bddee83-4e25-4ba3-b3d7-4547eeb347ce,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bddee83-4e')
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:16,bridge_name='br-int',has_traffic_filtering=True,id=bbf6f9d2-6384-426f-a998-fb276fa27036,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf6f9d2-63') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:16,bridge_name='br-int',has_traffic_filtering=True,id=bbf6f9d2-6384-426f-a998-fb276fa27036,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf6f9d2-63') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbf6f9d2-63, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: INFO os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:16,bridge_name='br-int',has_traffic_filtering=True,id=bbf6f9d2-6384-426f-a998-fb276fa27036,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf6f9d2-63')
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f9:28,bridge_name='br-int',has_traffic_filtering=True,id=897ee821-0b60-41af-86cc-8fb8fcbb63bf,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897ee821-0b') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f9:28,bridge_name='br-int',has_traffic_filtering=True,id=897ee821-0b60-41af-86cc-8fb8fcbb63bf,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897ee821-0b') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap897ee821-0b, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: INFO nova.compute.manager [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Detaching volume e4415034-90d6-4b57-b797-d80bb15563bd
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: INFO os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f9:28,bridge_name='br-int',has_traffic_filtering=True,id=897ee821-0b60-41af-86cc-8fb8fcbb63bf,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897ee821-0b')
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:9e:c1,bridge_name='br-int',has_traffic_filtering=True,id=4c68f351-19c4-4d47-859c-6de061d29b5e,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c68f351-19') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:9e:c1,bridge_name='br-int',has_traffic_filtering=True,id=4c68f351-19c4-4d47-859c-6de061d29b5e,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c68f351-19') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c68f351-19, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:56 user nova-compute[70869]: INFO nova.virt.block_device [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Attempting to driver detach volume e4415034-90d6-4b57-b797-d80bb15563bd from mountpoint /dev/vdb
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Attempting to detach device vdb from instance 3a84f092-352e-4039-8dcb-bd4578458765 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:34:56 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:56 user nova-compute[70869]:   <source dev="/dev/sdj"/>
Jul 25 15:34:56 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:34:56 user nova-compute[70869]:   <serial>e4415034-90d6-4b57-b797-d80bb15563bd</serial>
Jul 25 15:34:56 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:34:56 user nova-compute[70869]: </disk>
Jul 25 15:34:56 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:56 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Successfully detached device vdb from instance 3a84f092-352e-4039-8dcb-bd4578458765 from the persistent domain config.
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a84f092-352e-4039-8dcb-bd4578458765 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:34:56 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:34:56 user nova-compute[70869]:   <source dev="/dev/sdj"/>
Jul 25 15:34:56 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:34:56 user nova-compute[70869]:   <serial>e4415034-90d6-4b57-b797-d80bb15563bd</serial>
Jul 25 15:34:56 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:34:56 user nova-compute[70869]: </disk>
Jul 25 15:34:56 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: INFO os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:9e:c1,bridge_name='br-int',has_traffic_filtering=True,id=4c68f351-19c4-4d47-859c-6de061d29b5e,network=Network(286f803f-0503-428b-8604-c0d7b713f0a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c68f351-19')
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:be:ab,bridge_name='br-int',has_traffic_filtering=True,id=2ebccfbf-e0ec-48fa-be10-4e23441c974b,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebccfbf-e0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:be:ab,bridge_name='br-int',has_traffic_filtering=True,id=2ebccfbf-e0ec-48fa-be10-4e23441c974b,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebccfbf-e0') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:56 user nova-compute[70869]: WARNING nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-870b555f-c0da-4f5e-bda0-b7fabc60bf16 for instance with vm_state active and task_state deleting.
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-unplugged-bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-bbf6f9d2-6384-426f-a998-fb276fa27036 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-bbf6f9d2-6384-426f-a998-fb276fa27036 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:56 user nova-compute[70869]: WARNING nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-bbf6f9d2-6384-426f-a998-fb276fa27036 for instance with vm_state active and task_state deleting.
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-unplugged-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-4c68f351-19c4-4d47-859c-6de061d29b5e for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:56 user nova-compute[70869]: WARNING nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-4c68f351-19c4-4d47-859c-6de061d29b5e for instance with vm_state active and task_state deleting.
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-unplugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:56 user nova-compute[70869]: WARNING nova.compute.manager [req-341a2a30-c53d-459d-8c6f-0de9ff9fb844 req-4944ee46-8f7a-4314-96bb-5454f8a1e628 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-2ebccfbf-e0ec-48fa-be10-4e23441c974b for instance with vm_state active and task_state deleting.
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ebccfbf-e0, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: INFO os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:be:ab,bridge_name='br-int',has_traffic_filtering=True,id=2ebccfbf-e0ec-48fa-be10-4e23441c974b,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebccfbf-e0')
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-182968880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-182968880',id=11,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfg7/xPABwyus1rGxBPNsbD5v+fIfEtlzmTUNS2XBcQPyGBCnMFgR+gqZsp3qV/axQAB8ksJ/XS/mIMYx0W08cue/cDNY3zjiKOYED18LbBnHEDcEdJO5SW7YhbSTM2Ug==',key_name='tempest-keypair-2043258224',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97ba47b47034968baabdd2f11ba829e',ramdisk_id='',reservation_id='r-cbb1s0s2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-213145236',owner_user_name='tempest-TaggedBootDevicesTest-213145236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbc9f3d11336441abf6bc378105758d8',uuid=dd06411a-f6dc-4e4a-894f-517410bda71d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converting VIF {"id": "aba97287-1fad-446f-ac84-dba0e2e8112e", "address": "fa:16:3e:cf:60:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba97287-1f", "ovs_interfaceid": "aba97287-1fad-446f-ac84-dba0e2e8112e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:60:ab,bridge_name='br-int',has_traffic_filtering=True,id=aba97287-1fad-446f-ac84-dba0e2e8112e,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba97287-1f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:60:ab,bridge_name='br-int',has_traffic_filtering=True,id=aba97287-1fad-446f-ac84-dba0e2e8112e,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba97287-1f') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaba97287-1f, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299296.9614224, 3a84f092-352e-4039-8dcb-bd4578458765 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a84f092-352e-4039-8dcb-bd4578458765 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:34:56 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Successfully detached device vdb from instance 3a84f092-352e-4039-8dcb-bd4578458765 from the live domain config.
Jul 25 15:34:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCrRewl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'e4415034-90d6-4b57-b797-d80bb15563bd'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:56 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3f173c-ac81-40e2-8a14-e62382835bd0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:57 user nova-compute[70869]: No targets found.
Jul 25 15:34:57 user nova-compute[70869]: iSNS:
Jul 25 15:34:57 user nova-compute[70869]: No targets found.
Jul 25 15:34:57 user nova-compute[70869]: STATIC:
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:57 user nova-compute[70869]: No targets found.
Jul 25 15:34:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:57 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:57 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: INFO os_vif [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:60:ab,bridge_name='br-int',has_traffic_filtering=True,id=aba97287-1fad-446f-ac84-dba0e2e8112e,network=Network(450609e0-d9f5-4626-9912-7ea2654e3dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba97287-1f')
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e499bf4c-3042-422c-89cd-f162052b6a4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZaATFPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:57 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f78f21f-985d-4fcf-91df-b545e0fbfce3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c144b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd'): ({'sdj'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Removing single pathed devices sdj {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50b498d-bf88-4b3e-9df7-9880d4f1d5b3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:57 user nova-compute[70869]: WARNING nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-897ee821-0b60-41af-86cc-8fb8fcbb63bf for instance with vm_state active and task_state deleting.
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-unplugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:57 user nova-compute[70869]: WARNING nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-f826bc9f-7358-4bac-9f9a-7fd060b7d350 for instance with vm_state active and task_state deleting.
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-unplugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-df166df8-3bd6-47fd-bf8c-e1ba2ed3da5a req-3cb416b9-cb82-4360-a5dd-3911c7208a86 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a31779f-3a2a-4dc8-b6c2-87b27dfa5fad]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Flushing IO for device /dev/sdj {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe1ef0f-79c8-40fc-bd06-b824776d3259]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e63d15-65dc-401b-b866-b932321f3b50]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] SCSI volumes sdj have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[238a5fe9-01af-4326-9660-051819d53a9c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff36ca02-5166-46f9-8603-fca8fbfafcec]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260]
Jul 25 15:34:57 user nova-compute[70869]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4415034-90d6-4b57-b797-d80bb15563bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3359c8d-8e04-4d8f-b78d-5c0b5583d700]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.547s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] <== disconnect_volume: return (548ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.491s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.039s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7781af85-1ea5-4c9e-aadf-449607e52d8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:57 user nova-compute[70869]: No targets found.
Jul 25 15:34:57 user nova-compute[70869]: iSNS:
Jul 25 15:34:57 user nova-compute[70869]: No targets found.
Jul 25 15:34:57 user nova-compute[70869]: STATIC:
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a
Jul 25 15:34:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:57 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:57 user nova-compute[70869]: No targets found.
Jul 25 15:34:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:57 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:57 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f81ee-4c4b-4f93-8973-1f702069166d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-unplugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:57 user nova-compute[70869]: WARNING nova.compute.manager [req-2071e671-c4bc-4ae5-ab23-f73479c02126 req-97cd3e2e-1b8b-4fbe-ab64-00abd29c1248 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-84f5c4a8-261e-4d46-add2-78f955d2d6cc for instance with vm_state active and task_state deleting.
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed16b047-0f8b-44d1-965a-5a0ac940f5a5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c1477f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1347f738-133f-479e-bb12-fef9f2051e8e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2386b86b-57bc-4d70-bade-ce282dc89e41]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c4c03a-598d-41b4-badd-615fde42d4cd]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a934c0a9-5929-434f-ac93-9b5a0e32ba54]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23065343030363366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_397974c1', '/dev/disk/by-id/scsi-1SCST_BIO397974c1-0e40063fdece1da1') {{(pid=82054) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8232654d-c194-4f98-a705-3dd7d4d096f5]: (4, None) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20ce81d-2505-486e-9beb-23f801b5d728]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --logout" returned: 0 in 0.188s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f89919-94c2-43bc-8edd-1bfc8b2ea325]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491, portal: 172.16.0.220,3260]
Jul 25 15:34:58 user nova-compute[70869]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12ff82e7-afb4-48c7-b82b-8c7d85f18491 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.079s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80fd328-97fb-4bd3-9cb2-522ff6f1c21b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.609s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] <== disconnect_volume: return (1100ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QVHzYraN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:58 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[542e7ea7-1061-43cd-9c58-c5c5d4f29423]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:58 user nova-compute[70869]: No targets found.
Jul 25 15:34:58 user nova-compute[70869]: iSNS:
Jul 25 15:34:58 user nova-compute[70869]: No targets found.
Jul 25 15:34:58 user nova-compute[70869]: STATIC:
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:58 user nova-compute[70869]: No targets found.
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:58 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:58 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Instance destroyed successfully.
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lazy-loading 'resources' on Instance uuid da94f076-89f8-40be-b8bb-f4f8a73953ae {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e695d-62dc-4517-8745-5a5eac4a4baa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:3c:67,bridge_name='br-int',has_traffic_filtering=True,id=f826bc9f-7358-4bac-9f9a-7fd060b7d350,network=Network(f21d0268-cb65-4a8c-9617-310edaa41ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf826bc9f-73') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:3c:67,bridge_name='br-int',has_traffic_filtering=True,id=f826bc9f-7358-4bac-9f9a-7fd060b7d350,network=Network(f21d0268-cb65-4a8c-9617-310edaa41ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf826bc9f-73') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf826bc9f-73, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ef7859-19da-4e94-bb32-1089c74d8253]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c3335b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a'): ({'sdb'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Removing single pathed devices sdb {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[101fd746-13e5-493d-99bd-4f271ceb5189]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: INFO os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:3c:67,bridge_name='br-int',has_traffic_filtering=True,id=f826bc9f-7358-4bac-9f9a-7fd060b7d350,network=Network(f21d0268-cb65-4a8c-9617-310edaa41ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf826bc9f-73')
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=20bd65f0-1d1d-4c3c-a7eb-4712eef84404,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20bd65f0-1d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=20bd65f0-1d1d-4c3c-a7eb-4712eef84404,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20bd65f0-1d') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20bd65f0-1d, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2256c61b-6d42-40be-9b86-4c4fdae6d051]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Flushing IO for device /dev/sdb {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d53ecfb-dcdc-43f7-ac6c-e161c30f4d44]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: INFO os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0d:d3,bridge_name='br-int',has_traffic_filtering=True,id=20bd65f0-1d1d-4c3c-a7eb-4712eef84404,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap20bd65f0-1d')
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=5b3e2d62-2cb8-4c19-8edd-1ae36bdced65,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b3e2d62-2c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=5b3e2d62-2cb8-4c19-8edd-1ae36bdced65,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b3e2d62-2c') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b3e2d62-2c, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.078s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76225e0-d627-48b3-96b8-8401cecd7420]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:58 user nova-compute[70869]: INFO os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2e:46,bridge_name='br-int',has_traffic_filtering=True,id=5b3e2d62-2cb8-4c19-8edd-1ae36bdced65,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b3e2d62-2c')
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:59:13,bridge_name='br-int',has_traffic_filtering=True,id=5ae3ba86-1b57-403c-ab34-9f65aff4c95e,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae3ba86-1b') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:59:13,bridge_name='br-int',has_traffic_filtering=True,id=5ae3ba86-1b57-403c-ab34-9f65aff4c95e,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae3ba86-1b') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ae3ba86-1b, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4e102b-babd-4df5-8ca4-93ae91e28669]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: INFO os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:59:13,bridge_name='br-int',has_traffic_filtering=True,id=5ae3ba86-1b57-403c-ab34-9f65aff4c95e,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ae3ba86-1b')
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "address": "fa:16:3e:6a:db:1c", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f5c4a8-26", "ovs_interfaceid": "84f5c4a8-261e-4d46-add2-78f955d2d6cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:db:1c,bridge_name='br-int',has_traffic_filtering=True,id=84f5c4a8-261e-4d46-add2-78f955d2d6cc,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f5c4a8-26') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:db:1c,bridge_name='br-int',has_traffic_filtering=True,id=84f5c4a8-261e-4d46-add2-78f955d2d6cc,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f5c4a8-26') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84f5c4a8-26, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: INFO os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:db:1c,bridge_name='br-int',has_traffic_filtering=True,id=84f5c4a8-261e-4d46-add2-78f955d2d6cc,network=Network(b61b7a0d-8c1f-45b4-942d-dfa19c4645de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f5c4a8-26')
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:dd:a2,bridge_name='br-int',has_traffic_filtering=True,id=5e1ad59c-808c-4702-acdc-b95a29dbb164,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1ad59c-80') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:dd:a2,bridge_name='br-int',has_traffic_filtering=True,id=5e1ad59c-808c-4702-acdc-b95a29dbb164,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1ad59c-80') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e1ad59c-80, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0ef7e6-8861-45bc-8e8f-3a34412a7d39]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a, portal: 172.16.0.220,3260]
Jul 25 15:34:58 user nova-compute[70869]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:58 user nova-compute[70869]: INFO os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:dd:a2,bridge_name='br-int',has_traffic_filtering=True,id=5e1ad59c-808c-4702-acdc-b95a29dbb164,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1ad59c-80')
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1341946241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1341946241',id=12,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMnBLOmwKtL27J6qKrddU+xqIwa4MWtVmRcspUEw1Rdli9GH355ROZvO2YsJSKu5Ty4J+tZRi5ZcAzhwubE9WzJ6kZfcSzSDQXY2PKF3qRr1haXM/w1JalM/B2puggKvQ==',key_name='tempest-keypair-897651438',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b435a0b68ec412388fb4d85e0df701e',ramdisk_id='',reservation_id='r-0j3rx0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-820690677',owner_user_name='tempest-TaggedBootDevicesTest_v242-820690677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0980deba3f4e4b6e8ef276d2502e7bfb',uuid=da94f076-89f8-40be-b8bb-f4f8a73953ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converting VIF {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:62,bridge_name='br-int',has_traffic_filtering=True,id=56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b1eda8-f8') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:62,bridge_name='br-int',has_traffic_filtering=True,id=56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b1eda8-f8') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56b1eda8-f8, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lazy-loading 'flavor' on Instance uuid 3a84f092-352e-4039-8dcb-bd4578458765 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:34:58 user nova-compute[70869]: INFO os_vif [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:62,bridge_name='br-int',has_traffic_filtering=True,id=56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d,network=Network(b924928b-abe5-43ba-8236-f69d3a3b52b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56b1eda8-f8')
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLUTjqxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:58 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b11d21-4b1c-4b4c-bcea-8c4d97b5551a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4498611-e5b8-4adf-87ad-41b2f473b606]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] <== disconnect_volume: return (447ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.022s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoHTJYRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:58 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e1d88dd8-8312-4125-a554-4bbe75e60410 tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.327s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b7b19f-e623-4d78-a4f2-a4497f25eda2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:58 user nova-compute[70869]: No targets found.
Jul 25 15:34:58 user nova-compute[70869]: iSNS:
Jul 25 15:34:58 user nova-compute[70869]: No targets found.
Jul 25 15:34:58 user nova-compute[70869]: STATIC:
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:58 user nova-compute[70869]: No targets found.
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:58 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:58 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-unplugged-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-unplugged-aba97287-1fad-446f-ac84-dba0e2e8112e for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-plugged-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Acquiring lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] No waiting events found dispatching network-vif-plugged-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:58 user nova-compute[70869]: WARNING nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received unexpected event network-vif-plugged-aba97287-1fad-446f-ac84-dba0e2e8112e for instance with vm_state active and task_state deleting.
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-unplugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:58 user nova-compute[70869]: WARNING nova.compute.manager [req-0d136be2-e7c2-4992-a9d9-cf1329369a4d req-61251755-7bca-498c-a570-464ae3ea70ce service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-5b3e2d62-2cb8-4c19-8edd-1ae36bdced65 for instance with vm_state active and task_state deleting.
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fada0ba1-7820-4af2-a270-c17b343122fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc18178b-9b21-4f5c-9fd7-ee1f328c6b38]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe434275480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[82745c69-5aa8-4c92-b43a-47f5a440da9e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e36f33-9ec8-47b5-a930-8876beaabfd2]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b2fd5e-9f78-4f51-b6d3-a1566c369356]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f453bb-48e0-4eb2-acdb-7d7cce6ffbae]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df31617-9d4f-4fed-b586-e37699dbe4d2]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[055d0876-2cc9-4407-bb24-06f500907732]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1, portal: 172.16.0.220,3260]
Jul 25 15:34:58 user nova-compute[70869]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17bd7b79-d155-49ef-a6dd-a3b8826067b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38bbf64-0426-4645-8c54-5e15da8b89bf]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] <== disconnect_volume: return (357ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.333s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sBmWteuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:58 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684fa2f-3b34-4230-986f-236d7aff368b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:58 user nova-compute[70869]: No targets found.
Jul 25 15:34:58 user nova-compute[70869]: iSNS:
Jul 25 15:34:58 user nova-compute[70869]: No targets found.
Jul 25 15:34:58 user nova-compute[70869]: STATIC:
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:58 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:58 user nova-compute[70869]: No targets found.
Jul 25 15:34:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:58 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:58 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea17e655-f28b-44e7-9b46-92313729ffa0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e733fc2-83d4-4efa-8a43-82cab3515e1d]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c23c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262'): ({'sdf'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Removing single pathed devices sdf {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae644fa9-caa6-457b-bca0-fc6e03d1100a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3990c2-314c-4a94-91c2-010d1e8041cf]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Flushing IO for device /dev/sdf {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c9c06-593c-40bb-b4d7-b85ee365beda]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c62470-06e7-4250-aa91-7918404b48c4]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] SCSI volumes sdf have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767bdec-cc2b-4ad9-aa3e-703f1567ce3c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4ee9ef-237f-48f3-aca8-4ad8270b762b]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262, portal: 172.16.0.220,3260]
Jul 25 15:34:59 user nova-compute[70869]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed140be-a203-423f-a217-502077c1a262 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4755f-471a-4e6f-9036-ac085fc3a37d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] <== disconnect_volume: return (662ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:59 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Deleting instance files /opt/stack/data/nova/instances/dd06411a-f6dc-4e4a-894f-517410bda71d_del
Jul 25 15:34:59 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Deletion of /opt/stack/data/nova/instances/dd06411a-f6dc-4e4a-894f-517410bda71d_del complete
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.332s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ca5c0-3d96-4917-94ec-794eab90bd2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:34:59 user nova-compute[70869]: No targets found.
Jul 25 15:34:59 user nova-compute[70869]: iSNS:
Jul 25 15:34:59 user nova-compute[70869]: No targets found.
Jul 25 15:34:59 user nova-compute[70869]: STATIC:
Jul 25 15:34:59 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:34:59 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:59 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:59 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:34:59 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:59 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:59 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9
Jul 25 15:34:59 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:34:59 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:34:59 user nova-compute[70869]: FIRMWARE:
Jul 25 15:34:59 user nova-compute[70869]: No targets found.
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:34:59 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:34:59 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f140d48-88ea-4f20-bb4c-142f1b508ca6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:59 user nova-compute[70869]: WARNING nova.compute.manager [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-20bd65f0-1d1d-4c3c-a7eb-4712eef84404 for instance with vm_state active and task_state deleting.
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-unplugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:59 user nova-compute[70869]: WARNING nova.compute.manager [req-427f1947-a6af-4f23-8af7-feeff5b9485b req-959f7c52-f960-46fa-a38e-bb6c20bf1995 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-5ae3ba86-1b57-403c-ab34-9f65aff4c95e for instance with vm_state active and task_state deleting.
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0373d44d-194d-404b-b296-711c83d6a76c]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c146830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:34:59 user nova-compute[70869]: INFO nova.compute.manager [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Took 5.16 seconds to destroy the instance on the hypervisor.
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad96a0f-e76c-4bda-b785-14d2fc560ad4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7ef7e0-6dc0-4bc9-8332-b1b8f6fcf485]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:34:59 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Creating image(s)
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Ensure instance console log exists: /opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Start _get_guest_xml network_info=[{"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b4fd0aba-7f4a-4671-9fb8-cc933ae4c8fc', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgmhefxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a525e472-1e7b-40b5-a4b1-5ba8bae313c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 'serial': 'a7d4a3f2-1140-4be4-a32c-a56b6661a89e'}, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4071ae78-5cfd-4a56-82a6-0d0f18ebc4c0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:34:59 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgmhefxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:59 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9936cc-b59e-4ecf-9379-404124df8fb4]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36d90b0-0fce-448c-91f0-2d0b68844519]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[157ae467-4014-4ecb-a5f8-228b2b0d0825]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9, portal: 172.16.0.220,3260]
Jul 25 15:34:59 user nova-compute[70869]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d211ee9-c939-419e-88ae-dfd771f027b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ad8c1c-cf76-4aad-b06c-4cbf13932090]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] <== disconnect_volume: return (653ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.129s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:59 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:34:59 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRNIvZqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:34:59 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffb094f-646f-4a01-81de-4dff09b73cf1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:34:59 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c55b334-1efe-4cab-baec-b9f2936eed1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e] added
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-unplugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:59 user nova-compute[70869]: WARNING nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-5e1ad59c-808c-4702-acdc-b95a29dbb164 for instance with vm_state active and task_state deleting.
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-unplugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-unplugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-plugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Acquiring lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] No waiting events found dispatching network-vif-plugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:34:59 user nova-compute[70869]: WARNING nova.compute.manager [req-8ed0a69a-5e0b-43f3-be16-b37f642c6a07 req-70cc1bd5-2e35-40e1-8ebb-819ae32d3b1f service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received unexpected event network-vif-plugged-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d for instance with vm_state active and task_state deleting.
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b9a233-cb0a-494a-bd8d-f4c9465e485c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f440e3e-af14-4a65-9aec-9c033c9d41af]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgmhefxQ {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgmhefxQ" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd96a389-b73e-484f-b0a8-25c82f57cad8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FgmhefxQ'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d97564c-2d6e-4620-89cd-de1fa6106e9c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e20ee9f-9f26-4c14-93bc-de121548c03a]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cd189d-c917-4371-aa05-d08f5b14ca5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e, portal: 172.16.0.220,3260]
Jul 25 15:34:59 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e, portal: 172.16.0.220,3260] successful.
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76e884-3d83-469a-ad61-918c0939fd6e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea1b0a1-7ea7-41c9-b279-3ff4b0b54f0f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:34:59 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aa1f00-d431-4f01-b39b-7db69dc84900]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:34:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgmhefxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '26262633339626564', 'path': '/dev/sdb'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262633339626564', 'path': '/dev/sdb'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.319s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60201b-9ac6-4385-8f20-e37313dda6af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:35:00 user nova-compute[70869]: No targets found.
Jul 25 15:35:00 user nova-compute[70869]: iSNS:
Jul 25 15:35:00 user nova-compute[70869]: No targets found.
Jul 25 15:35:00 user nova-compute[70869]: STATIC:
Jul 25 15:35:00 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73
Jul 25 15:35:00 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:00 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:00 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:35:00 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:00 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:00 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:35:00 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:00 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:00 user nova-compute[70869]: FIRMWARE:
Jul 25 15:35:00 user nova-compute[70869]: No targets found.
Jul 25 15:35:00 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:35:00 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:35:00 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1613461442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1613461442',id=15,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-1kc1pjj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:34:44Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=a525e472-1e7b-40b5-a4b1-5ba8bae313c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:77:eb,bridge_name='br-int',has_traffic_filtering=True,id=f433efca-963a-44ce-99c2-b1c4488c564a,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf433efca-96') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'pci_devices' on Instance uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:35:00 user nova-compute[70869]:   <uuid>a525e472-1e7b-40b5-a4b1-5ba8bae313c9</uuid>
Jul 25 15:35:00 user nova-compute[70869]:   <name>instance-0000000f</name>
Jul 25 15:35:00 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:35:00 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:35:00 user nova-compute[70869]:   <metadata>
Jul 25 15:35:00 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:35:00 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:35:00 user nova-compute[70869]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1613461442</nova:name>
Jul 25 15:35:00 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:34:59</nova:creationTime>
Jul 25 15:35:00 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:35:00 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:35:00 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:35:00 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:35:00 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:35:00 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:35:00 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:35:00 user nova-compute[70869]:       <nova:owner>
Jul 25 15:35:00 user nova-compute[70869]:         <nova:user uuid="02dfa618b8fc4b06b5e396b7da9e8443">tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member</nova:user>
Jul 25 15:35:00 user nova-compute[70869]:         <nova:project uuid="3735c3192f424a8abee7c1874609f005">tempest-ServerBootFromVolumeStableRescueTest-508290498</nova:project>
Jul 25 15:35:00 user nova-compute[70869]:       </nova:owner>
Jul 25 15:35:00 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:35:00 user nova-compute[70869]:       <nova:ports>
Jul 25 15:35:00 user nova-compute[70869]:         <nova:port uuid="f433efca-963a-44ce-99c2-b1c4488c564a">
Jul 25 15:35:00 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:35:00 user nova-compute[70869]:         </nova:port>
Jul 25 15:35:00 user nova-compute[70869]:       </nova:ports>
Jul 25 15:35:00 user nova-compute[70869]:     </nova:instance>
Jul 25 15:35:00 user nova-compute[70869]:   </metadata>
Jul 25 15:35:00 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:35:00 user nova-compute[70869]:     <system>
Jul 25 15:35:00 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:35:00 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:35:00 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:35:00 user nova-compute[70869]:       <entry name="serial">a525e472-1e7b-40b5-a4b1-5ba8bae313c9</entry>
Jul 25 15:35:00 user nova-compute[70869]:       <entry name="uuid">a525e472-1e7b-40b5-a4b1-5ba8bae313c9</entry>
Jul 25 15:35:00 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:35:00 user nova-compute[70869]:     </system>
Jul 25 15:35:00 user nova-compute[70869]:   </sysinfo>
Jul 25 15:35:00 user nova-compute[70869]:   <os>
Jul 25 15:35:00 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:35:00 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:35:00 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:35:00 user nova-compute[70869]:   </os>
Jul 25 15:35:00 user nova-compute[70869]:   <features>
Jul 25 15:35:00 user nova-compute[70869]:     <acpi/>
Jul 25 15:35:00 user nova-compute[70869]:     <apic/>
Jul 25 15:35:00 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:35:00 user nova-compute[70869]:   </features>
Jul 25 15:35:00 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:35:00 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:35:00 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:35:00 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:35:00 user nova-compute[70869]:   </clock>
Jul 25 15:35:00 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:35:00 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:35:00 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:35:00 user nova-compute[70869]:   </cpu>
Jul 25 15:35:00 user nova-compute[70869]:   <devices>
Jul 25 15:35:00 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:35:00 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:35:00 user nova-compute[70869]:       <source dev="/dev/sdb"/>
Jul 25 15:35:00 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:35:00 user nova-compute[70869]:       <serial>a7d4a3f2-1140-4be4-a32c-a56b6661a89e</serial>
Jul 25 15:35:00 user nova-compute[70869]:     </disk>
Jul 25 15:35:00 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:35:00 user nova-compute[70869]:       <mac address="fa:16:3e:4d:77:eb"/>
Jul 25 15:35:00 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:35:00 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:35:00 user nova-compute[70869]:       <target dev="tapf433efca-96"/>
Jul 25 15:35:00 user nova-compute[70869]:     </interface>
Jul 25 15:35:00 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:35:00 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/console.log" append="off"/>
Jul 25 15:35:00 user nova-compute[70869]:     </serial>
Jul 25 15:35:00 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:35:00 user nova-compute[70869]:     <video>
Jul 25 15:35:00 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:35:00 user nova-compute[70869]:     </video>
Jul 25 15:35:00 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:35:00 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:35:00 user nova-compute[70869]:     </rng>
Jul 25 15:35:00 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:35:00 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:35:00 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:35:00 user nova-compute[70869]:     </memballoon>
Jul 25 15:35:00 user nova-compute[70869]:   </devices>
Jul 25 15:35:00 user nova-compute[70869]: </domain>
Jul 25 15:35:00 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1613461442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1613461442',id=15,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-1kc1pjj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:34:44Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=a525e472-1e7b-40b5-a4b1-5ba8bae313c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:77:eb,bridge_name='br-int',has_traffic_filtering=True,id=f433efca-963a-44ce-99c2-b1c4488c564a,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf433efca-96') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG os_vif [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:77:eb,bridge_name='br-int',has_traffic_filtering=True,id=f433efca-963a-44ce-99c2-b1c4488c564a,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf433efca-96') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1052c291-5176-4b2e-8c63-e0dc3db5c82f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf433efca-96, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf433efca-96, col_values=(('external_ids', {'iface-id': 'f433efca-963a-44ce-99c2-b1c4488c564a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:77:eb', 'vm-uuid': 'a525e472-1e7b-40b5-a4b1-5ba8bae313c9'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:01 user nova-compute[70869]: INFO os_vif [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:77:eb,bridge_name='br-int',has_traffic_filtering=True,id=f433efca-963a-44ce-99c2-b1c4488c564a,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf433efca-96')
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d688b3-6780-434c-8265-43c062ccc103]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:01 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:35:01 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:01 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:01 user nova-compute[70869]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 (non-flash)
Jul 25 15:35:01 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:01 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c37a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73'): ({'sdg'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Removing single pathed devices sdg {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b7fab1-1872-4b96-8eb9-6140bc557d17]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4f61e6-5ae3-4672-bbb5-e86127b7e740]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Flushing IO for device /dev/sdg {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No VIF found with MAC fa:16:3e:4d:77:eb, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f16640-19a8-4cd4-bca3-7075b6585bb3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[df675d02-c93f-44f3-ade3-c96222017e5b]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] SCSI volumes sdg have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9280167c-1490-487f-aeb8-91003657c6d9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b4edf-699b-42d8-bc9c-36907f75f447]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73, portal: 172.16.0.220,3260]
Jul 25 15:35:01 user nova-compute[70869]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73, portal: 172.16.0.220,3260] successful.
Jul 25 15:35:01 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88223f23-8512-4177-baa6-9a1dbec47f73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e5ee6a-2668-41ca-b8d3-bd3e0eb988dc]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] <== disconnect_volume: return (1633ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:35:01 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Deleting instance files /opt/stack/data/nova/instances/da94f076-89f8-40be-b8bb-f4f8a73953ae_del
Jul 25 15:35:01 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Deletion of /opt/stack/data/nova/instances/da94f076-89f8-40be-b8bb-f4f8a73953ae_del complete
Jul 25 15:35:01 user nova-compute[70869]: INFO nova.compute.manager [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Took 5.19 seconds to destroy the instance on the hypervisor.
Jul 25 15:35:01 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-1b4f6baa-2ae4-4735-8f0e-160b8d637e31 req-c7282a21-df2e-45e6-aad4-0728572df0ab service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-deleted-aba97287-1fad-446f-ac84-dba0e2e8112e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:01 user nova-compute[70869]: INFO nova.compute.manager [req-1b4f6baa-2ae4-4735-8f0e-160b8d637e31 req-c7282a21-df2e-45e6-aad4-0728572df0ab service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Neutron deleted interface aba97287-1fad-446f-ac84-dba0e2e8112e; detaching it from the instance and deleting it from the info cache
Jul 25 15:35:01 user nova-compute[70869]: DEBUG nova.network.neutron [req-1b4f6baa-2ae4-4735-8f0e-160b8d637e31 req-c7282a21-df2e-45e6-aad4-0728572df0ab service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [{"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c68f351-19c4-4d47-859c-6de061d29b5e", "address": "fa:16:3e:31:9e:c1", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c68f351-19", "ovs_interfaceid": "4c68f351-19c4-4d47-859c-6de061d29b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-1b4f6baa-2ae4-4735-8f0e-160b8d637e31 req-c7282a21-df2e-45e6-aad4-0728572df0ab service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Detach interface failed, port_id=aba97287-1fad-446f-ac84-dba0e2e8112e, reason: Instance dd06411a-f6dc-4e4a-894f-517410bda71d could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:35:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-6a409429-be18-4a83-bcd2-a3d9f6d9a0f7 req-e60eb1e1-14d6-4f6f-8d12-b58e0f603519 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-deleted-84f5c4a8-261e-4d46-add2-78f955d2d6cc {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:03 user nova-compute[70869]: INFO nova.compute.manager [req-6a409429-be18-4a83-bcd2-a3d9f6d9a0f7 req-e60eb1e1-14d6-4f6f-8d12-b58e0f603519 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Neutron deleted interface 84f5c4a8-261e-4d46-add2-78f955d2d6cc; detaching it from the instance and deleting it from the info cache
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.network.neutron [req-6a409429-be18-4a83-bcd2-a3d9f6d9a0f7 req-e60eb1e1-14d6-4f6f-8d12-b58e0f603519 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [{"id": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "address": "fa:16:3e:d0:3c:67", "network": {"id": "f21d0268-cb65-4a8c-9617-310edaa41ebf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-235129625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf826bc9f-73", "ovs_interfaceid": "f826bc9f-7358-4bac-9f9a-7fd060b7d350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-6a409429-be18-4a83-bcd2-a3d9f6d9a0f7 req-e60eb1e1-14d6-4f6f-8d12-b58e0f603519 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Detach interface failed, port_id=84f5c4a8-261e-4d46-add2-78f955d2d6cc, reason: Instance da94f076-89f8-40be-b8bb-f4f8a73953ae could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-deleted-4c68f351-19c4-4d47-859c-6de061d29b5e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:03 user nova-compute[70869]: INFO nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Neutron deleted interface 4c68f351-19c4-4d47-859c-6de061d29b5e; detaching it from the instance and deleting it from the info cache
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.network.neutron [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [{"id": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "address": "fa:16:3e:de:3e:3c", "network": {"id": "95965bd0-a6d1-4725-ba2b-ef035c839102", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2129155061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870b555f-c0", "ovs_interfaceid": "870b555f-c0da-4f5e-bda0-b7fabc60bf16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Detach interface failed, port_id=4c68f351-19c4-4d47-859c-6de061d29b5e, reason: Instance dd06411a-f6dc-4e4a-894f-517410bda71d could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:03 user nova-compute[70869]: WARNING nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state building and task_state spawning.
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-deleted-870b555f-c0da-4f5e-bda0-b7fabc60bf16 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:03 user nova-compute[70869]: INFO nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Neutron deleted interface 870b555f-c0da-4f5e-bda0-b7fabc60bf16; detaching it from the instance and deleting it from the info cache
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.network.neutron [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [{"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "address": "fa:16:3e:d4:be:ab", "network": {"id": "450609e0-d9f5-4626-9912-7ea2654e3dc1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1532525592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebccfbf-e0", "ovs_interfaceid": "2ebccfbf-e0ec-48fa-be10-4e23441c974b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Detach interface failed, port_id=870b555f-c0da-4f5e-bda0-b7fabc60bf16, reason: Instance dd06411a-f6dc-4e4a-894f-517410bda71d could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:03 user nova-compute[70869]: WARNING nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state building and task_state spawning.
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-deleted-2ebccfbf-e0ec-48fa-be10-4e23441c974b {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:03 user nova-compute[70869]: INFO nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Neutron deleted interface 2ebccfbf-e0ec-48fa-be10-4e23441c974b; detaching it from the instance and deleting it from the info cache
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.network.neutron [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [{"id": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "address": "fa:16:3e:f3:9d:06", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bddee83-4e", "ovs_interfaceid": "4bddee83-4e25-4ba3-b3d7-4547eeb347ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bbf6f9d2-6384-426f-a998-fb276fa27036", "address": "fa:16:3e:43:d7:16", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf6f9d2-63", "ovs_interfaceid": "bbf6f9d2-6384-426f-a998-fb276fa27036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "address": "fa:16:3e:36:f9:28", "network": {"id": "286f803f-0503-428b-8604-c0d7b713f0a5", "bridge": "br-int", "label": "tempest-device-tagging-net1-2005583324", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.58", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c97ba47b47034968baabdd2f11ba829e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap897ee821-0b", "ovs_interfaceid": "897ee821-0b60-41af-86cc-8fb8fcbb63bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-fb9eda48-26bd-40f2-95b3-b615e16f1760 req-630eb53a-86b2-410b-af44-7da5f3707e0e service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Detach interface failed, port_id=2ebccfbf-e0ec-48fa-be10-4e23441c974b, reason: Instance dd06411a-f6dc-4e4a-894f-517410bda71d could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:04 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Took 4.77 seconds to deallocate network for instance.
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299304.497543, a525e472-1e7b-40b5-a4b1-5ba8bae313c9 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:04 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] VM Resumed (Lifecycle Event)
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:35:04 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Instance spawned successfully.
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:04 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299304.499178, a525e472-1e7b-40b5-a4b1-5ba8bae313c9 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:04 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] VM Started (Lifecycle Event)
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:35:04 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:35:04 user nova-compute[70869]: INFO nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Took 5.22 seconds to spawn the instance on the hypervisor.
Jul 25 15:35:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:04 user nova-compute[70869]: INFO nova.compute.manager [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Took 21.71 seconds to build instance.
Jul 25 15:35:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e9e7d00-5781-4c56-b79a-5324fd7c6be0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.810s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-deleted-f826bc9f-7358-4bac-9f9a-7fd060b7d350 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:05 user nova-compute[70869]: INFO nova.compute.manager [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Neutron deleted interface f826bc9f-7358-4bac-9f9a-7fd060b7d350; detaching it from the instance and deleting it from the info cache
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.network.neutron [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [{"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "address": "fa:16:3e:31:59:13", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ae3ba86-1b", "ovs_interfaceid": "5ae3ba86-1b57-403c-ab34-9f65aff4c95e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Detach interface failed, port_id=f826bc9f-7358-4bac-9f9a-7fd060b7d350, reason: Instance da94f076-89f8-40be-b8bb-f4f8a73953ae could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-deleted-5ae3ba86-1b57-403c-ab34-9f65aff4c95e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:05 user nova-compute[70869]: INFO nova.compute.manager [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Neutron deleted interface 5ae3ba86-1b57-403c-ab34-9f65aff4c95e; detaching it from the instance and deleting it from the info cache
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.network.neutron [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [{"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "address": "fa:16:3e:bf:77:62", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56b1eda8-f8", "ovs_interfaceid": "56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Detach interface failed, port_id=5ae3ba86-1b57-403c-ab34-9f65aff4c95e, reason: Instance da94f076-89f8-40be-b8bb-f4f8a73953ae could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-deleted-56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:05 user nova-compute[70869]: INFO nova.compute.manager [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Neutron deleted interface 56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d; detaching it from the instance and deleting it from the info cache
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.network.neutron [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [{"id": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "address": "fa:16:3e:cd:0d:d3", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bd65f0-1d", "ovs_interfaceid": "20bd65f0-1d1d-4c3c-a7eb-4712eef84404", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "address": "fa:16:3e:32:2e:46", "network": {"id": "b61b7a0d-8c1f-45b4-942d-dfa19c4645de", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930983338", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3e2d62-2c", "ovs_interfaceid": "5b3e2d62-2cb8-4c19-8edd-1ae36bdced65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "address": "fa:16:3e:25:dd:a2", "network": {"id": "b924928b-abe5-43ba-8236-f69d3a3b52b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-237208451", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b435a0b68ec412388fb4d85e0df701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1ad59c-80", "ovs_interfaceid": "5e1ad59c-808c-4702-acdc-b95a29dbb164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-ebccc1c9-17f2-4b3f-9953-84a92cebede8 req-d2bfca42-bf63-429d-a51b-783c56d48457 service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Detach interface failed, port_id=56b1eda8-f8a2-4dfb-8b3c-79bd46f7529d, reason: Instance da94f076-89f8-40be-b8bb-f4f8a73953ae could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:05 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Took 4.02 seconds to deallocate network for instance.
Jul 25 15:35:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-59caf3ca-e005-4895-9693-7ea50012ce09 req-a2bb6608-2eac-463a-ae3b-d5f6312d86e6 service nova] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Received event network-vif-deleted-897ee821-0b60-41af-86cc-8fb8fcbb63bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:06 user nova-compute[70869]: INFO nova.compute.manager [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Took 2.31 seconds to detach 3 volumes for instance.
Jul 25 15:35:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:06 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:35:06 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:35:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:06 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Deleted allocations for instance dd06411a-f6dc-4e4a-894f-517410bda71d
Jul 25 15:35:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-52b8cd7a-97e7-42c8-9576-5faee4e0dad7 tempest-TaggedBootDevicesTest-213145236 tempest-TaggedBootDevicesTest-213145236-project-member] Lock "dd06411a-f6dc-4e4a-894f-517410bda71d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.830s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-11967786-08c7-425b-92a8-46f5b6df2abd req-e80f0be2-4731-4cd0-83c2-d170b225b66d service nova] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Received event network-vif-deleted-5e1ad59c-808c-4702-acdc-b95a29dbb164 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:07 user nova-compute[70869]: INFO nova.compute.manager [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Took 2.31 seconds to detach 3 volumes for instance.
Jul 25 15:35:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:08 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:35:08 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:35:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:08 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Deleted allocations for instance da94f076-89f8-40be-b8bb-f4f8a73953ae
Jul 25 15:35:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6b8269f-6cee-425d-964d-7fb7376eb248 tempest-TaggedBootDevicesTest_v242-820690677 tempest-TaggedBootDevicesTest_v242-820690677-project-member] Lock "da94f076-89f8-40be-b8bb-f4f8a73953ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.067s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:10 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299295.9458163, dd06411a-f6dc-4e4a-894f-517410bda71d => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:10 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] VM Stopped (Lifecycle Event)
Jul 25 15:35:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1b0659a-af94-47ea-b61a-6fbac7ec820d None None] [instance: dd06411a-f6dc-4e4a-894f-517410bda71d] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:35:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:35:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:35:11 user nova-compute[70869]: INFO nova.compute.claims [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Claim successful on node user
Jul 25 15:35:11 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:35:11 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:35:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:35:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.policy [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56ffae89ce9840258e11b4866a315821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df48376ed604fc09522486062251014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:35:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Creating image(s)
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "/opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "/opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk 1073741824" returned: 0 in 0.058s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Successfully created port: 259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Cannot resize image /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lazy-loading 'migration_context' on Instance uuid 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Ensure instance console log exists: /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299298.201617, da94f076-89f8-40be-b8bb-f4f8a73953ae => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:13 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] VM Stopped (Lifecycle Event)
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-82586311-0109-42a6-adb0-3967a871aa71 None None] [instance: da94f076-89f8-40be-b8bb-f4f8a73953ae] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Successfully updated port: 259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "refresh_cache-7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquired lock "refresh_cache-7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-b713570a-ed50-43b5-aa3e-f24b7b632b6f req-0bb48af9-c05b-4b25-a21d-b765b448df6e service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received event network-changed-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-b713570a-ed50-43b5-aa3e-f24b7b632b6f req-0bb48af9-c05b-4b25-a21d-b765b448df6e service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Refreshing instance network info cache due to event network-changed-259c9482-9299-49f0-9e0c-6e1d3e65a5c5. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b713570a-ed50-43b5-aa3e-f24b7b632b6f req-0bb48af9-c05b-4b25-a21d-b765b448df6e service nova] Acquiring lock "refresh_cache-7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Updating instance_info_cache with network_info: [{"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Releasing lock "refresh_cache-7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Instance network_info: |[{"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b713570a-ed50-43b5-aa3e-f24b7b632b6f req-0bb48af9-c05b-4b25-a21d-b765b448df6e service nova] Acquired lock "refresh_cache-7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-b713570a-ed50-43b5-aa3e-f24b7b632b6f req-0bb48af9-c05b-4b25-a21d-b765b448df6e service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Refreshing network info cache for port 259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Start _get_guest_xml network_info=[{"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:35:13 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:35:13 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1818466798',display_name='tempest-VolumesAdminNegativeTest-server-1818466798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1818466798',id=16,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9df48376ed604fc09522486062251014',ramdisk_id='',reservation_id='r-zqj66cd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-45810269',owner_user_name='tempest-VolumesAdminNegativeTest-45810269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:35:12Z,user_data=None,user_id='56ffae89ce9840258e11b4866a315821',uuid=7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converting VIF {"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:fa:7d,bridge_name='br-int',has_traffic_filtering=True,id=259c9482-9299-49f0-9e0c-6e1d3e65a5c5,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c9482-92') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:35:13 user nova-compute[70869]:   <uuid>7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f</uuid>
Jul 25 15:35:13 user nova-compute[70869]:   <name>instance-00000010</name>
Jul 25 15:35:13 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:35:13 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:35:13 user nova-compute[70869]:   <metadata>
Jul 25 15:35:13 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:35:13 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:35:13 user nova-compute[70869]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1818466798</nova:name>
Jul 25 15:35:13 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:35:13</nova:creationTime>
Jul 25 15:35:13 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:35:13 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:35:13 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:35:13 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:35:13 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:35:13 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:35:13 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:35:13 user nova-compute[70869]:       <nova:owner>
Jul 25 15:35:13 user nova-compute[70869]:         <nova:user uuid="56ffae89ce9840258e11b4866a315821">tempest-VolumesAdminNegativeTest-45810269-project-member</nova:user>
Jul 25 15:35:13 user nova-compute[70869]:         <nova:project uuid="9df48376ed604fc09522486062251014">tempest-VolumesAdminNegativeTest-45810269</nova:project>
Jul 25 15:35:13 user nova-compute[70869]:       </nova:owner>
Jul 25 15:35:13 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:35:13 user nova-compute[70869]:       <nova:ports>
Jul 25 15:35:13 user nova-compute[70869]:         <nova:port uuid="259c9482-9299-49f0-9e0c-6e1d3e65a5c5">
Jul 25 15:35:13 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 15:35:13 user nova-compute[70869]:         </nova:port>
Jul 25 15:35:13 user nova-compute[70869]:       </nova:ports>
Jul 25 15:35:13 user nova-compute[70869]:     </nova:instance>
Jul 25 15:35:13 user nova-compute[70869]:   </metadata>
Jul 25 15:35:13 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:35:13 user nova-compute[70869]:     <system>
Jul 25 15:35:13 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:35:13 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:35:13 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:35:13 user nova-compute[70869]:       <entry name="serial">7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f</entry>
Jul 25 15:35:13 user nova-compute[70869]:       <entry name="uuid">7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f</entry>
Jul 25 15:35:13 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:35:13 user nova-compute[70869]:     </system>
Jul 25 15:35:13 user nova-compute[70869]:   </sysinfo>
Jul 25 15:35:13 user nova-compute[70869]:   <os>
Jul 25 15:35:13 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:35:13 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:35:13 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:35:13 user nova-compute[70869]:   </os>
Jul 25 15:35:13 user nova-compute[70869]:   <features>
Jul 25 15:35:13 user nova-compute[70869]:     <acpi/>
Jul 25 15:35:13 user nova-compute[70869]:     <apic/>
Jul 25 15:35:13 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:35:13 user nova-compute[70869]:   </features>
Jul 25 15:35:13 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:35:13 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:35:13 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:35:13 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:35:13 user nova-compute[70869]:   </clock>
Jul 25 15:35:13 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:35:13 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:35:13 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:35:13 user nova-compute[70869]:   </cpu>
Jul 25 15:35:13 user nova-compute[70869]:   <devices>
Jul 25 15:35:13 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:35:13 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:35:13 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk"/>
Jul 25 15:35:13 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:35:13 user nova-compute[70869]:     </disk>
Jul 25 15:35:13 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:35:13 user nova-compute[70869]:       <mac address="fa:16:3e:06:fa:7d"/>
Jul 25 15:35:13 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:35:13 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:35:13 user nova-compute[70869]:       <target dev="tap259c9482-92"/>
Jul 25 15:35:13 user nova-compute[70869]:     </interface>
Jul 25 15:35:13 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:35:13 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/console.log" append="off"/>
Jul 25 15:35:13 user nova-compute[70869]:     </serial>
Jul 25 15:35:13 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:35:13 user nova-compute[70869]:     <video>
Jul 25 15:35:13 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:35:13 user nova-compute[70869]:     </video>
Jul 25 15:35:13 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:35:13 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:35:13 user nova-compute[70869]:     </rng>
Jul 25 15:35:13 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:35:13 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:35:13 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:35:13 user nova-compute[70869]:     </memballoon>
Jul 25 15:35:13 user nova-compute[70869]:   </devices>
Jul 25 15:35:13 user nova-compute[70869]: </domain>
Jul 25 15:35:13 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1818466798',display_name='tempest-VolumesAdminNegativeTest-server-1818466798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1818466798',id=16,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9df48376ed604fc09522486062251014',ramdisk_id='',reservation_id='r-zqj66cd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-45810269',owner_user_name='tempest-VolumesAdminNegativeTest-45810269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:35:12Z,user_data=None,user_id='56ffae89ce9840258e11b4866a315821',uuid=7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converting VIF {"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:fa:7d,bridge_name='br-int',has_traffic_filtering=True,id=259c9482-9299-49f0-9e0c-6e1d3e65a5c5,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c9482-92') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG os_vif [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:fa:7d,bridge_name='br-int',has_traffic_filtering=True,id=259c9482-9299-49f0-9e0c-6e1d3e65a5c5,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c9482-92') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap259c9482-92, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap259c9482-92, col_values=(('external_ids', {'iface-id': '259c9482-9299-49f0-9e0c-6e1d3e65a5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:fa:7d', 'vm-uuid': '7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:13 user nova-compute[70869]: INFO os_vif [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:fa:7d,bridge_name='br-int',has_traffic_filtering=True,id=259c9482-9299-49f0-9e0c-6e1d3e65a5c5,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c9482-92')
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] No VIF found with MAC fa:16:3e:06:fa:7d, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:35:14 user nova-compute[70869]: DEBUG nova.network.neutron [req-b713570a-ed50-43b5-aa3e-f24b7b632b6f req-0bb48af9-c05b-4b25-a21d-b765b448df6e service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Updated VIF entry in instance network info cache for port 259c9482-9299-49f0-9e0c-6e1d3e65a5c5. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:35:14 user nova-compute[70869]: DEBUG nova.network.neutron [req-b713570a-ed50-43b5-aa3e-f24b7b632b6f req-0bb48af9-c05b-4b25-a21d-b765b448df6e service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Updating instance_info_cache with network_info: [{"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b713570a-ed50-43b5-aa3e-f24b7b632b6f req-0bb48af9-c05b-4b25-a21d-b765b448df6e service nova] Releasing lock "refresh_cache-7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:35:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-a50e7a95-f8a5-4d9d-ba51-f36f2f17dc8d req-42581d96-78db-409c-a11c-42feb4ea9a7d service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received event network-vif-plugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a50e7a95-f8a5-4d9d-ba51-f36f2f17dc8d req-42581d96-78db-409c-a11c-42feb4ea9a7d service nova] Acquiring lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a50e7a95-f8a5-4d9d-ba51-f36f2f17dc8d req-42581d96-78db-409c-a11c-42feb4ea9a7d service nova] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a50e7a95-f8a5-4d9d-ba51-f36f2f17dc8d req-42581d96-78db-409c-a11c-42feb4ea9a7d service nova] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-a50e7a95-f8a5-4d9d-ba51-f36f2f17dc8d req-42581d96-78db-409c-a11c-42feb4ea9a7d service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] No waiting events found dispatching network-vif-plugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:15 user nova-compute[70869]: WARNING nova.compute.manager [req-a50e7a95-f8a5-4d9d-ba51-f36f2f17dc8d req-42581d96-78db-409c-a11c-42feb4ea9a7d service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received unexpected event network-vif-plugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 for instance with vm_state building and task_state spawning.
Jul 25 15:35:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299317.4178865, 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:17 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] VM Resumed (Lifecycle Event)
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:35:17 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Instance spawned successfully.
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:17 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299317.420762, 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:17 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] VM Started (Lifecycle Event)
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:35:17 user nova-compute[70869]: INFO nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Took 5.40 seconds to spawn the instance on the hypervisor.
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:17 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-bdb9377a-a488-49a0-a88e-1396844568f2 req-4946a6f4-c19d-43d8-820b-b8ee3fa6a2d4 service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received event network-vif-plugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bdb9377a-a488-49a0-a88e-1396844568f2 req-4946a6f4-c19d-43d8-820b-b8ee3fa6a2d4 service nova] Acquiring lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bdb9377a-a488-49a0-a88e-1396844568f2 req-4946a6f4-c19d-43d8-820b-b8ee3fa6a2d4 service nova] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bdb9377a-a488-49a0-a88e-1396844568f2 req-4946a6f4-c19d-43d8-820b-b8ee3fa6a2d4 service nova] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-bdb9377a-a488-49a0-a88e-1396844568f2 req-4946a6f4-c19d-43d8-820b-b8ee3fa6a2d4 service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] No waiting events found dispatching network-vif-plugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:17 user nova-compute[70869]: WARNING nova.compute.manager [req-bdb9377a-a488-49a0-a88e-1396844568f2 req-4946a6f4-c19d-43d8-820b-b8ee3fa6a2d4 service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received unexpected event network-vif-plugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 for instance with vm_state building and task_state spawning.
Jul 25 15:35:17 user nova-compute[70869]: INFO nova.compute.manager [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Took 6.15 seconds to build instance.
Jul 25 15:35:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cdfa90d2-89de-4387-9eab-3e9a9d5eff29 tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.256s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:23 user nova-compute[70869]: INFO nova.compute.manager [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Terminating instance
Jul 25 15:35:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-5005bfff-e39b-4c3e-a58e-b2553cf0c900 req-2ef55f2e-a7a3-4418-b3ba-4b50f265fdf5 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received event network-vif-unplugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5005bfff-e39b-4c3e-a58e-b2553cf0c900 req-2ef55f2e-a7a3-4418-b3ba-4b50f265fdf5 service nova] Acquiring lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5005bfff-e39b-4c3e-a58e-b2553cf0c900 req-2ef55f2e-a7a3-4418-b3ba-4b50f265fdf5 service nova] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5005bfff-e39b-4c3e-a58e-b2553cf0c900 req-2ef55f2e-a7a3-4418-b3ba-4b50f265fdf5 service nova] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-5005bfff-e39b-4c3e-a58e-b2553cf0c900 req-2ef55f2e-a7a3-4418-b3ba-4b50f265fdf5 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] No waiting events found dispatching network-vif-unplugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-5005bfff-e39b-4c3e-a58e-b2553cf0c900 req-2ef55f2e-a7a3-4418-b3ba-4b50f265fdf5 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received event network-vif-unplugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:24 user nova-compute[70869]: INFO nova.compute.manager [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Terminating instance
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Instance destroyed successfully.
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lazy-loading 'resources' on Instance uuid 1093381e-c322-4ed0-91cb-1a8e956f8dfd {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-365092138',display_name='tempest-ServersNegativeTestJSON-server-365092138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-365092138',id=13,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e50fe153def490bae620115f0dc4b50',ramdisk_id='',reservation_id='r-d0641y9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-454996836',owner_user_name='tempest-ServersNegativeTestJSON-454996836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:43Z,user_data=None,user_id='47d1f853b9564b8ca6e60577241fed35',uuid=1093381e-c322-4ed0-91cb-1a8e956f8dfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converting VIF {"id": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "address": "fa:16:3e:8b:1d:cc", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e1b7502-6d", "ovs_interfaceid": "5e1b7502-6d07-4969-8e5a-6799f133a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=5e1b7502-6d07-4969-8e5a-6799f133a9c6,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1b7502-6d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG os_vif [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=5e1b7502-6d07-4969-8e5a-6799f133a9c6,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1b7502-6d') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e1b7502-6d, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:24 user nova-compute[70869]: INFO os_vif [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=5e1b7502-6d07-4969-8e5a-6799f133a9c6,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e1b7502-6d')
Jul 25 15:35:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Deleting instance files /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd_del
Jul 25 15:35:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Deletion of /opt/stack/data/nova/instances/1093381e-c322-4ed0-91cb-1a8e956f8dfd_del complete
Jul 25 15:35:24 user nova-compute[70869]: INFO nova.compute.manager [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 25 15:35:24 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-ccea1d7b-9972-4735-ae6b-9fc2d8c5558c req-7d2febb5-2dfb-46ba-aaaf-490a9b9ebb85 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-unplugged-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ccea1d7b-9972-4735-ae6b-9fc2d8c5558c req-7d2febb5-2dfb-46ba-aaaf-490a9b9ebb85 service nova] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ccea1d7b-9972-4735-ae6b-9fc2d8c5558c req-7d2febb5-2dfb-46ba-aaaf-490a9b9ebb85 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ccea1d7b-9972-4735-ae6b-9fc2d8c5558c req-7d2febb5-2dfb-46ba-aaaf-490a9b9ebb85 service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-ccea1d7b-9972-4735-ae6b-9fc2d8c5558c req-7d2febb5-2dfb-46ba-aaaf-490a9b9ebb85 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] No waiting events found dispatching network-vif-unplugged-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-ccea1d7b-9972-4735-ae6b-9fc2d8c5558c req-7d2febb5-2dfb-46ba-aaaf-490a9b9ebb85 service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-unplugged-9911ada1-3a21-4e33-be13-d786a18560fd for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:35:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Instance destroyed successfully.
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lazy-loading 'resources' on Instance uuid b6c9b6d1-5006-4160-a559-ea5c46e7c4ff {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-25T15:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1881880919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1881880919',id=9,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQCnjUFS4GVvp1uY+i4MWSiPTipwFlk1fAmhL09GyrCSrjDVSQvYyS8MW2Ahfcl4CTdExtioOorFgZMog5w/XI0cedHfxpHuJtENl/M1IXTFU2CPc7Y1H/+dLskGA8s5g==',key_name='tempest-keypair-1573765752',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e5e728d1bdf4015b917d1d77e7a2e75',ramdisk_id='',reservation_id='r-enxwzktb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1524187401',owner_user_name='tempest-TaggedAttachmentsTest-1524187401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21c066cfdbd498a9ac779e762799d2b',uuid=b6c9b6d1-5006-4160-a559-ea5c46e7c4ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converting VIF {"id": "9911ada1-3a21-4e33-be13-d786a18560fd", "address": "fa:16:3e:cc:c8:d3", "network": {"id": "31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916518377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5e728d1bdf4015b917d1d77e7a2e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9911ada1-3a", "ovs_interfaceid": "9911ada1-3a21-4e33-be13-d786a18560fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c8:d3,bridge_name='br-int',has_traffic_filtering=True,id=9911ada1-3a21-4e33-be13-d786a18560fd,network=Network(31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9911ada1-3a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG os_vif [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c8:d3,bridge_name='br-int',has_traffic_filtering=True,id=9911ada1-3a21-4e33-be13-d786a18560fd,network=Network(31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9911ada1-3a') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9911ada1-3a, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:35:25 user nova-compute[70869]: INFO os_vif [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:c8:d3,bridge_name='br-int',has_traffic_filtering=True,id=9911ada1-3a21-4e33-be13-d786a18560fd,network=Network(31a3f154-ebd4-44ed-a4f2-2f7ac32c6cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9911ada1-3a')
Jul 25 15:35:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Deleting instance files /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff_del
Jul 25 15:35:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Deletion of /opt/stack/data/nova/instances/b6c9b6d1-5006-4160-a559-ea5c46e7c4ff_del complete
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:25 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Took 0.62 seconds to deallocate network for instance.
Jul 25 15:35:25 user nova-compute[70869]: INFO nova.compute.manager [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Took 1.04 seconds to destroy the instance on the hypervisor.
Jul 25 15:35:25 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:35:25 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Deleted allocations for instance 1093381e-c322-4ed0-91cb-1a8e956f8dfd
Jul 25 15:35:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:35:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ad96688b-1d06-451d-82cd-14aa1e99f03d tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.270s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-6d6a2e11-f732-4c7c-8b6f-fefe73a62449 req-2f484cb0-9b8a-435b-8e32-b11223c829b6 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received event network-vif-plugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6d6a2e11-f732-4c7c-8b6f-fefe73a62449 req-2f484cb0-9b8a-435b-8e32-b11223c829b6 service nova] Acquiring lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6d6a2e11-f732-4c7c-8b6f-fefe73a62449 req-2f484cb0-9b8a-435b-8e32-b11223c829b6 service nova] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6d6a2e11-f732-4c7c-8b6f-fefe73a62449 req-2f484cb0-9b8a-435b-8e32-b11223c829b6 service nova] Lock "1093381e-c322-4ed0-91cb-1a8e956f8dfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-6d6a2e11-f732-4c7c-8b6f-fefe73a62449 req-2f484cb0-9b8a-435b-8e32-b11223c829b6 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] No waiting events found dispatching network-vif-plugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:26 user nova-compute[70869]: WARNING nova.compute.manager [req-6d6a2e11-f732-4c7c-8b6f-fefe73a62449 req-2f484cb0-9b8a-435b-8e32-b11223c829b6 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received unexpected event network-vif-plugged-5e1b7502-6d07-4969-8e5a-6799f133a9c6 for instance with vm_state deleted and task_state None.
Jul 25 15:35:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-6d6a2e11-f732-4c7c-8b6f-fefe73a62449 req-2f484cb0-9b8a-435b-8e32-b11223c829b6 service nova] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Received event network-vif-deleted-5e1b7502-6d07-4969-8e5a-6799f133a9c6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:26 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Took 1.06 seconds to deallocate network for instance.
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-7809a97f-8d23-401b-a4c9-75a89587e718 req-a97893b0-9ccf-4c2f-bd5a-b692320e28ef service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-plugged-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7809a97f-8d23-401b-a4c9-75a89587e718 req-a97893b0-9ccf-4c2f-bd5a-b692320e28ef service nova] Acquiring lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7809a97f-8d23-401b-a4c9-75a89587e718 req-a97893b0-9ccf-4c2f-bd5a-b692320e28ef service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7809a97f-8d23-401b-a4c9-75a89587e718 req-a97893b0-9ccf-4c2f-bd5a-b692320e28ef service nova] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-7809a97f-8d23-401b-a4c9-75a89587e718 req-a97893b0-9ccf-4c2f-bd5a-b692320e28ef service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] No waiting events found dispatching network-vif-plugged-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:26 user nova-compute[70869]: WARNING nova.compute.manager [req-7809a97f-8d23-401b-a4c9-75a89587e718 req-a97893b0-9ccf-4c2f-bd5a-b692320e28ef service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received unexpected event network-vif-plugged-9911ada1-3a21-4e33-be13-d786a18560fd for instance with vm_state deleted and task_state None.
Jul 25 15:35:26 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Deleted allocations for instance b6c9b6d1-5006-4160-a559-ea5c46e7c4ff
Jul 25 15:35:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f0445b-5a6c-4632-84a2-a53c763a8a57 tempest-TaggedAttachmentsTest-1524187401 tempest-TaggedAttachmentsTest-1524187401-project-member] Lock "b6c9b6d1-5006-4160-a559-ea5c46e7c4ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.648s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:27 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating instance_info_cache with network_info: [{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:35:27 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:35:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-584faa45-c284-40cb-9bd8-29f7812c4a19 req-3ac34761-3517-4036-b7b9-fb9f4352723d service nova] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Received event network-vif-deleted-9911ada1-3a21-4e33-be13-d786a18560fd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:28 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:28 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:28 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:35:29 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:29 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:29 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:35:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:35:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:32 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:35:32 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:35:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7572MB free_disk=25.759925842285156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fa170559-5228-448f-acea-c5b816a22631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 08fa2836-717a-4893-8969-fcab677935a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3a84f092-352e-4039-8dcb-bd4578458765 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3b38a39b-5ad8-4341-b132-597b8ab6a849 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:35:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:35:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:37 user nova-compute[70869]: DEBUG nova.objects.instance [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'flavor' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:38 user nova-compute[70869]: INFO nova.compute.manager [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Attaching volume cad17826-a657-4886-8a99-934a955ac72d to /dev/vdb
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.utils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a1946c-6437-4ce3-b98f-b2c506eec8fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39ec964-07b9-439a-9562-0c3955896810]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ca1606-2223-4a5d-ace3-b339767ef797]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[82815ef6-01bc-4da1-b629-8b3839aa78f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:35:38 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2832688b-5452-4270-8a7d-43b3dd4d839c]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.utils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating existing volume attachment record: d6b0b60f-837e-425b-9add-5cc84af87be3 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG nova.objects.instance [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'flavor' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:38 user nova-compute[70869]: INFO nova.compute.manager [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Attaching volume 2f9c954d-f52d-4445-b157-08bf6946d203 to /dev/vdb
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.utils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf8e187-3244-404e-a7c1-798019960c66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f33724d-f307-4637-8ab9-d310422eccc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eb5d9e-939b-4096-b695-134b26ffe9ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8170e6bb-e255-4e6c-8fdd-0ae6bc78890e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:35:38 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:35:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c30f68-7a38-40d5-b391-ae2ac65743b1]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG os_brick.utils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:38 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating existing volume attachment record: 1bd3b8af-4849-46d0-a719-02d096d8c08c {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:35:39 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299324.3475387, 1093381e-c322-4ed0-91cb-1a8e956f8dfd => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:39 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] VM Stopped (Lifecycle Event)
Jul 25 15:35:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43079529-e297-470d-9272-90649fd93c5b None None] [instance: 1093381e-c322-4ed0-91cb-1a8e956f8dfd] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:39 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299324.9943268, b6c9b6d1-5006-4160-a559-ea5c46e7c4ff => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:39 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] VM Stopped (Lifecycle Event)
Jul 25 15:35:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e9c65b6c-32cb-44ca-97f1-3d043188e8d9 None None] [instance: b6c9b6d1-5006-4160-a559-ea5c46e7c4ff] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-65484bfe-c91f-4593-adca-850156faa064 req-9f08680a-5aa0-4a26-b7d4-de0de19dc420 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-changed-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-65484bfe-c91f-4593-adca-850156faa064 req-9f08680a-5aa0-4a26-b7d4-de0de19dc420 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Refreshing instance network info cache due to event network-changed-7bde5f26-2d7a-4e3e-adff-311873ad7a87. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:35:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-65484bfe-c91f-4593-adca-850156faa064 req-9f08680a-5aa0-4a26-b7d4-de0de19dc420 service nova] Acquiring lock "refresh_cache-3b38a39b-5ad8-4341-b132-597b8ab6a849" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:35:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-65484bfe-c91f-4593-adca-850156faa064 req-9f08680a-5aa0-4a26-b7d4-de0de19dc420 service nova] Acquired lock "refresh_cache-3b38a39b-5ad8-4341-b132-597b8ab6a849" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:35:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-65484bfe-c91f-4593-adca-850156faa064 req-9f08680a-5aa0-4a26-b7d4-de0de19dc420 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Refreshing network info cache for port 7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:35:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-65484bfe-c91f-4593-adca-850156faa064 req-9f08680a-5aa0-4a26-b7d4-de0de19dc420 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Updated VIF entry in instance network info cache for port 7bde5f26-2d7a-4e3e-adff-311873ad7a87. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:35:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-65484bfe-c91f-4593-adca-850156faa064 req-9f08680a-5aa0-4a26-b7d4-de0de19dc420 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Updating instance_info_cache with network_info: [{"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-65484bfe-c91f-4593-adca-850156faa064 req-9f08680a-5aa0-4a26-b7d4-de0de19dc420 service nova] Releasing lock "refresh_cache-3b38a39b-5ad8-4341-b132-597b8ab6a849" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXMCkbBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:46 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:46 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:46 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb665d2-a2de-4b39-a2a7-45a0d355177e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:35:46 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.067s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[815aa518-cad7-40ab-b3e5-7298cb3d9dfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d] added
Jul 25 15:35:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60e16b0-4919-492b-b85c-490e1960719e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d127998f-17e9-4d0f-ba9d-c7b3a96dc532]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXMCkbBu {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXMCkbBu" returned: 0 in 0.086s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba99d6e0-34a2-40ae-908c-eafa72791e92]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YXMCkbBu'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f502f806-8d92-49cc-9d0f-e7d9bcf0c96c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[895352bc-21c4-45cd-aa4c-8022e782f370]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:46 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:46 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ea46b5-2932-4aee-b1f1-fe42bf4eed2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d, portal: 172.16.0.220,3260]
Jul 25 15:35:46 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d, portal: 172.16.0.220,3260] successful.
Jul 25 15:35:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6044a790-6426-484e-8176-0daf3dd85ce7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e3819f-c475-48c1-a9e3-eaa3df284417]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:46 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:46 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:46 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:46 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:35:46 user nova-compute[70869]: INFO nova.compute.manager [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Rebuilding instance
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c93c7c4-78d1-4ee1-920e-1fd5d52ec633]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXMCkbBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epzOyBXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:46 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:35:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b38a39b-5ad8-4341-b132-597b8ab6a849 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'pci_requests' on Instance uuid 3b38a39b-5ad8-4341-b132-597b8ab6a849 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b38a39b-5ad8-4341-b132-597b8ab6a849 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'resources' on Instance uuid 3b38a39b-5ad8-4341-b132-597b8ab6a849 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'migration_context' on Instance uuid 3b38a39b-5ad8-4341-b132-597b8ab6a849 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70869) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:46 user nova-compute[70869]: INFO nova.compute.manager [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Terminating instance
Jul 25 15:35:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-cb230649-eee1-48d2-a4c4-064df8990dd0 req-74625394-b8b4-4202-a96f-4cc6bb788ef2 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-unplugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cb230649-eee1-48d2-a4c4-064df8990dd0 req-74625394-b8b4-4202-a96f-4cc6bb788ef2 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cb230649-eee1-48d2-a4c4-064df8990dd0 req-74625394-b8b4-4202-a96f-4cc6bb788ef2 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cb230649-eee1-48d2-a4c4-064df8990dd0 req-74625394-b8b4-4202-a96f-4cc6bb788ef2 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-cb230649-eee1-48d2-a4c4-064df8990dd0 req-74625394-b8b4-4202-a96f-4cc6bb788ef2 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No waiting events found dispatching network-vif-unplugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:47 user nova-compute[70869]: WARNING nova.compute.manager [req-cb230649-eee1-48d2-a4c4-064df8990dd0 req-74625394-b8b4-4202-a96f-4cc6bb788ef2 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-unplugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state active and task_state rebuilding.
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.492s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '23565323735616161', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565323735616161', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:47 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:47 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG nova.objects.instance [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'flavor' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dbddd9-1e7c-4597-a620-e22bf05f9e6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:35:47 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:35:47 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:35:47 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:35:47 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:35:47 user nova-compute[70869]:   <serial>cad17826-a657-4886-8a99-934a955ac72d</serial>
Jul 25 15:35:47 user nova-compute[70869]: </disk>
Jul 25 15:35:47 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c488dc1f-3487-4a88-9400-70d29a5eae29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203] added
Jul 25 15:35:47 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[351e9e3d-4fcf-4554-bd90-dd5a0b62c6e8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38d8aed-6162-4e7c-b598-414895f98c79]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epzOyBXL {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epzOyBXL" returned: 0 in 0.040s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a20d94d-4000-44bd-873e-d70ca9742273]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epzOyBXL'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[53246bfd-8e4f-4f74-9ae5-2ce7f4b07bbe]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6576ec3e-7cb4-4f47-aa75-6e9fa183309f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:47 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:47 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance destroyed successfully.
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[40edaef4-14b5-41f8-9d7c-113a6a04069d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260]
Jul 25 15:35:47 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260] successful.
Jul 25 15:35:47 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance destroyed successfully.
Jul 25 15:35:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-779221569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-805847803',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkVAmxmlz9/k5ZXxC76vtVdp+U7q5KzaQBmndoNBkWoKxXxqljSS1jb5uYAjGuvcLIZ8lDA73m2VNNzORpITL5U/MKWIHqpe2k7cYW8WX1atjyqJ4EsYC2Jah+XtUpLw==',key_name='tempest-keypair-1784292135',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:34:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='27d4e6ad84894e2d8ca5aee1aa77db4e',ramdisk_id='',reservation_id='r-0fnuttbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1601506810',owner_user_name='tempest-ServerActionsV293TestJSON-1601506810-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:35:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0d6af7f176145f382a7cc839ed2c027',uuid=3b38a39b-5ad8-4341-b132-597b8ab6a849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converting VIF {"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_vif [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7d0cb2-f254-4464-b256-d812ded012a3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bde5f26-2d, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:47 user nova-compute[70869]: INFO os_vif [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d')
Jul 25 15:35:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awASrUZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:47 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b523f6-63df-47d9-8285-c24765b6a960]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:47 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:47 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:47 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.459s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[96095cad-eb34-46d9-9ec8-9a8aa0a194b5]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:35:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epzOyBXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:48 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Instance destroyed successfully.
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.objects.instance [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lazy-loading 'resources' on Instance uuid 3a84f092-352e-4039-8dcb-bd4578458765 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1642226982',display_name='tempest-TestVolumeSwap-server-1642226982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1642226982',id=8,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnOkx3HAoPtkWdlC8+9FqzZTopJtEeUeBvP1UWbhw0o7OJBh0EKd0GxdYIyVn5Jj1u/EKSNuN9/Qaoxx2hfCGkCa8zSieRQnSIT2Smsp7wXQVyYwfQ2mgP70e6jvzQQ0A==',key_name='tempest-keypair-1985031647',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86f5b012a5d9425c84d6a7edde907b89',ramdisk_id='',reservation_id='r-8oybzjer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-813504377',owner_user_name='tempest-TestVolumeSwap-813504377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7ff5accf4c429a8949143500dc3122',uuid=3a84f092-352e-4039-8dcb-bd4578458765,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Converting VIF {"id": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "address": "fa:16:3e:8b:58:87", "network": {"id": "bc2b010c-bbfe-4478-8a11-1be65adf9b02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1683801683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f5b012a5d9425c84d6a7edde907b89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52bceafd-7e", "ovs_interfaceid": "52bceafd-7e96-4a5e-b6b8-b834538e8f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:58:87,bridge_name='br-int',has_traffic_filtering=True,id=52bceafd-7e96-4a5e-b6b8-b834538e8f19,network=Network(bc2b010c-bbfe-4478-8a11-1be65adf9b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bceafd-7e') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG os_vif [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:58:87,bridge_name='br-int',has_traffic_filtering=True,id=52bceafd-7e96-4a5e-b6b8-b834538e8f19,network=Network(bc2b010c-bbfe-4478-8a11-1be65adf9b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bceafd-7e') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52bceafd-7e, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:35:48 user nova-compute[70869]: INFO os_vif [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:58:87,bridge_name='br-int',has_traffic_filtering=True,id=52bceafd-7e96-4a5e-b6b8-b834538e8f19,network=Network(bc2b010c-bbfe-4478-8a11-1be65adf9b02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52bceafd-7e')
Jul 25 15:35:48 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Deleting instance files /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765_del
Jul 25 15:35:48 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Deletion of /opt/stack/data/nova/instances/3a84f092-352e-4039-8dcb-bd4578458765_del complete
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] No VIF found with MAC fa:16:3e:30:bc:ad, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:35:48 user nova-compute[70869]: INFO nova.compute.manager [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Took 1.58 seconds to destroy the instance on the hypervisor.
Jul 25 15:35:48 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1b4b6ec0-9860-46ba-8cdf-61d12fb9a824 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.383s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.515s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== connect_volume: return (2518ms) {'type': 'block', 'scsi_wwn': '23737343864323636', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737343864323636', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.074s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.objects.instance [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'flavor' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f157c1-cd22-4468-b5db-f1d76a94c718]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:35:48 user nova-compute[70869]: No targets found.
Jul 25 15:35:48 user nova-compute[70869]: iSNS:
Jul 25 15:35:48 user nova-compute[70869]: No targets found.
Jul 25 15:35:48 user nova-compute[70869]: STATIC:
Jul 25 15:35:48 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:35:48 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:48 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:48 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d
Jul 25 15:35:48 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:48 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:48 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203
Jul 25 15:35:48 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:48 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:48 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:35:48 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:48 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:48 user nova-compute[70869]: FIRMWARE:
Jul 25 15:35:48 user nova-compute[70869]: No targets found.
Jul 25 15:35:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:35:48 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:35:48 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:35:48 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:35:48 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:35:48 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:35:48 user nova-compute[70869]:   <serial>2f9c954d-f52d-4445-b157-08bf6946d203</serial>
Jul 25 15:35:48 user nova-compute[70869]: </disk>
Jul 25 15:35:48 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7209128-eca5-4cd1-ac55-cededa3af6f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1aae1b-6143-4256-b349-406f560ff553]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:35:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe434142200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283'): ({'sdh'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Removing single pathed devices sdh {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[860b693f-8ba7-4510-a9bd-ac0bec2fb182]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e691e9cd-0b23-422f-a3e9-7ea40548bdb4]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Flushing IO for device /dev/sdh {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3464da-c5ad-4867-a3be-64bd984d46b2]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe833e2-7d9b-477b-891e-59c9d0e30c7d]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] SCSI volumes sdh have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e7a800-cad8-4fca-b3a0-72ca3f0a7b52]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26ddc47-03d0-4816-84a6-2b710597e892]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260]
Jul 25 15:35:49 user nova-compute[70869]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260] successful.
Jul 25 15:35:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25a2527-8e3d-415c-a249-ca51fee9b982]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] <== disconnect_volume: return (1428ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:35:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Deleting instance files /opt/stack/data/nova/instances/3b38a39b-5ad8-4341-b132-597b8ab6a849_del
Jul 25 15:35:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Deletion of /opt/stack/data/nova/instances/3b38a39b-5ad8-4341-b132-597b8ab6a849_del complete
Jul 25 15:35:49 user nova-compute[70869]: INFO nova.compute.manager [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Rescuing
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquired lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No VIF found with MAC fa:16:3e:51:e8:f2, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:35:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3b38a39b-5ad8-4341-b132-597b8ab6a849 could not be found.
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No waiting events found dispatching network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:49 user nova-compute[70869]: WARNING nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state active and task_state rebuilding.
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received event network-vif-unplugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] No waiting events found dispatching network-vif-unplugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received event network-vif-unplugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received event network-vif-plugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Acquiring lock "3a84f092-352e-4039-8dcb-bd4578458765-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Lock "3a84f092-352e-4039-8dcb-bd4578458765-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] No waiting events found dispatching network-vif-plugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:49 user nova-compute[70869]: WARNING nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received unexpected event network-vif-plugged-52bceafd-7e96-4a5e-b6b8-b834538e8f19 for instance with vm_state active and task_state deleting.
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No waiting events found dispatching network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:49 user nova-compute[70869]: WARNING nova.compute.manager [req-f7f94460-ad4c-4c27-8fad-b0a901c32f17 req-06534a80-e2eb-4927-a6fb-45bd17e721a1 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state active and task_state rebuilding.
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awASrUZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:49 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[426bbcc5-b80e-4f59-a894-978d5e0df218]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:35:49 user nova-compute[70869]: No targets found.
Jul 25 15:35:49 user nova-compute[70869]: iSNS:
Jul 25 15:35:49 user nova-compute[70869]: No targets found.
Jul 25 15:35:49 user nova-compute[70869]: STATIC:
Jul 25 15:35:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d
Jul 25 15:35:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203
Jul 25 15:35:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:49 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:35:49 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:49 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:49 user nova-compute[70869]: FIRMWARE:
Jul 25 15:35:49 user nova-compute[70869]: No targets found.
Jul 25 15:35:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:35:49 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:35:49 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b5f4ae-04b9-48f2-8284-4f44cf1141e6 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.046s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd1e516-191d-427a-bdcf-d297b6659a1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6805f90f-85f6-498b-b64c-1acbb926287a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:49 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe41c6bf910>, {}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Disconnecting from: [] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] <== disconnect_volume: return (86ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG nova.network.neutron [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating instance_info_cache with network_info: [{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Releasing lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:35:50 user nova-compute[70869]: INFO nova.compute.claims [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Claim successful on node user
Jul 25 15:35:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Preparing to wait for external event volume-reimaged-1fab0f90-3418-4b93-b8dd-d2bd164db283 {{(pid=70869) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:50 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:50 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Took 2.52 seconds to deallocate network for instance.
Jul 25 15:35:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fa170559-5228-448f-acea-c5b816a22631] Instance destroyed successfully.
Jul 25 15:35:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Attempting a stable device rescue
Jul 25 15:35:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70869) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Instance directory exists: not creating {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 15:35:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Creating image(s)
Jul 25 15:35:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "dfa204b660194b29a3665940772ce33d5887cfce" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "dfa204b660194b29a3665940772ce33d5887cfce" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:35:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.337s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No event matching network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 in dict_keys([('volume-reimaged', '1fab0f90-3418-4b93-b8dd-d2bd164db283')]) {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Jul 25 15:35:52 user nova-compute[70869]: WARNING nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state active and task_state rebuilding.
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-unplugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No event matching network-vif-unplugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 in dict_keys([('volume-reimaged', '1fab0f90-3418-4b93-b8dd-d2bd164db283')]) {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Jul 25 15:35:52 user nova-compute[70869]: WARNING nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-unplugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state active and task_state rebuilding.
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No event matching network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 in dict_keys([('volume-reimaged', '1fab0f90-3418-4b93-b8dd-d2bd164db283')]) {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Jul 25 15:35:52 user nova-compute[70869]: WARNING nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state active and task_state rebuilding.
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Received event network-vif-deleted-52bceafd-7e96-4a5e-b6b8-b834538e8f19 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-unplugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-unplugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:52 user nova-compute[70869]: WARNING nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-unplugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state active and task_state rescuing.
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:52 user nova-compute[70869]: WARNING nova.compute.manager [req-aac77f05-47fe-4336-bfe3-5cced2a1ece7 req-1a2080d7-e247-450e-a493-7bd8565771b3 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state active and task_state rescuing.
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:35:52 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce.part --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.virt.images [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] 00547a90-6145-41d9-8278-14ac558e7d83 was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce.part /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:52 user nova-compute[70869]: INFO nova.compute.manager [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Rebuilding instance
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.policy [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d528e01a08f40d4b598ab8222c2edf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f5d520a39742c69302f96795d0ea61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:52 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'pci_requests' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:35:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Creating image(s)
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "/opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "/opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "/opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.066s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'pci_devices' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'resources' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'migration_context' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce.part /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce.converted" returned: 0 in 0.979s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70869) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.224s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "dfa204b660194b29a3665940772ce33d5887cfce" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.232s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "dfa204b660194b29a3665940772ce33d5887cfce" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "dfa204b660194b29a3665940772ce33d5887cfce" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.208s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.192s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:53 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Deleted allocations for instance 3a84f092-352e-4039-8dcb-bd4578458765
Jul 25 15:35:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk 1073741824" returned: 0 in 0.062s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce --force-share --output=json" returned: 0 in 0.236s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce,backing_fmt=raw /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce,backing_fmt=raw /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue" returned: 0 in 0.070s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "dfa204b660194b29a3665940772ce33d5887cfce" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'migration_context' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1018b5c7-5594-44d4-a635-cd7a5310029d tempest-TestVolumeSwap-813504377 tempest-TestVolumeSwap-813504377-project-member] Lock "3a84f092-352e-4039-8dcb-bd4578458765" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.012s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Start _get_guest_xml network_info=[{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "vif_mac": "fa:16:3e:30:bc:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '00547a90-6145-41d9-8278-14ac558e7d83', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd6b0b60f-837e-425b-9add-5cc84af87be3', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXMCkbBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fa170559-5228-448f-acea-c5b816a22631', 'attached_at': '', 'detached_at': '', 'volume_id': 'cad17826-a657-4886-8a99-934a955ac72d', 'serial': 'cad17826-a657-4886-8a99-934a955ac72d'}, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'resources' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.191s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'numa_topology' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:53 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:35:53 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXMCkbBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:53 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:35:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:53 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:35:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:53 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-4bb68e81-ab02-4741-b1d3-e05a5eca489b req-0e477b8a-b5c3-40e8-ba30-cc03824e1598 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-unplugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4bb68e81-ab02-4741-b1d3-e05a5eca489b req-0e477b8a-b5c3-40e8-ba30-cc03824e1598 service nova] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4bb68e81-ab02-4741-b1d3-e05a5eca489b req-0e477b8a-b5c3-40e8-ba30-cc03824e1598 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4bb68e81-ab02-4741-b1d3-e05a5eca489b req-0e477b8a-b5c3-40e8-ba30-cc03824e1598 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-4bb68e81-ab02-4741-b1d3-e05a5eca489b req-0e477b8a-b5c3-40e8-ba30-cc03824e1598 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] No waiting events found dispatching network-vif-unplugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:53 user nova-compute[70869]: WARNING nova.compute.manager [req-4bb68e81-ab02-4741-b1d3-e05a5eca489b req-0e477b8a-b5c3-40e8-ba30-cc03824e1598 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received unexpected event network-vif-unplugged-b7d31348-a01c-40f7-993c-e350d788f767 for instance with vm_state active and task_state rebuilding.
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Cannot resize image /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'migration_context' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Ensure instance console log exists: /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71b925c-9d04-44da-8d75-5f24c0a484f6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YXMCkbBu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 25 15:35:53 user nova-compute[70869]: node.name = iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d
Jul 25 15:35:53 user nova-compute[70869]: node.tpgt = -1
Jul 25 15:35:53 user nova-compute[70869]: node.startup = automatic
Jul 25 15:35:53 user nova-compute[70869]: node.leading_login = No
Jul 25 15:35:53 user nova-compute[70869]: iface.iscsi_ifacename = default
Jul 25 15:35:53 user nova-compute[70869]: iface.net_ifacename = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.ipaddress = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.prefix_len = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.hwaddress = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.transport_name = tcp
Jul 25 15:35:53 user nova-compute[70869]: iface.initiatorname = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.state = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.vlan_id = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.vlan_priority = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.vlan_state = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.iface_num = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.mtu = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.port = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.bootproto = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.subnet_mask = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.gateway = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.dhcp_alt_client_id_state = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.dhcp_alt_client_id = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.dhcp_dns = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.dhcp_learn_iqn = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.dhcp_req_vendor_id_state = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.dhcp_vendor_id_state = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.dhcp_vendor_id = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.dhcp_slp_da = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.fragmentation = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.gratuitous_arp = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.incoming_forwarding = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.tos_state = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.tos = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.ttl = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.delayed_ack = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.tcp_nagle = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.tcp_wsf_state = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.tcp_wsf = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.tcp_timer_scale = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.tcp_timestamp = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.redirect = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.def_task_mgmt_timeout = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.header_digest = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.data_digest = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.immediate_data = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.initial_r2t = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.data_seq_inorder = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.data_pdu_inorder = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.erl = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.max_receive_data_len = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.first_burst_len = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.max_outstanding_r2t = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.max_burst_len = 0
Jul 25 15:35:53 user nova-compute[70869]: iface.chap_auth = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.bidi_chap = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.strict_login_compliance = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.discovery_auth = <empty>
Jul 25 15:35:53 user nova-compute[70869]: iface.discovery_logout = <empty>
Jul 25 15:35:53 user nova-compute[70869]: node.discovery_address = <empty>
Jul 25 15:35:53 user nova-compute[70869]: node.discovery_port = 0
Jul 25 15:35:53 user nova-compute[70869]: node.discovery_type = static
Jul 25 15:35:53 user nova-compute[70869]: node.session.initial_cmdsn = 0
Jul 25 15:35:53 user nova-compute[70869]: node.session.initial_login_retry_max = 8
Jul 25 15:35:53 user nova-compute[70869]: node.session.xmit_thread_priority = -20
Jul 25 15:35:53 user nova-compute[70869]: node.session.cmds_max = 128
Jul 25 15:35:53 user nova-compute[70869]: node.session.queue_depth = 32
Jul 25 15:35:53 user nova-compute[70869]: node.session.nr_sessions = 1
Jul 25 15:35:53 user nova-compute[70869]: node.session.auth.authmethod = CHAP
Jul 25 15:35:53 user nova-compute[70869]: node.session.auth.username = YXMCkbBu
Jul 25 15:35:53 user nova-compute[70869]: node.session.auth.password = ***
Jul 25 15:35:53 user nova-compute[70869]: node.session.auth.username_in = <empty>
Jul 25 15:35:53 user nova-compute[70869]: node.session.auth.password_in = <empty>
Jul 25 15:35:53 user nova-compute[70869]: node.session.auth.chap_algs = MD5
Jul 25 15:35:53 user nova-compute[70869]: node.session.timeo.replacement_timeout = 120
Jul 25 15:35:53 user nova-compute[70869]: node.session.err_timeo.abort_timeout = 15
Jul 25 15:35:53 user nova-compute[70869]: node.session.err_timeo.lu_reset_timeout = 30
Jul 25 15:35:53 user nova-compute[70869]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 25 15:35:53 user nova-compute[70869]: node.session.err_timeo.host_reset_timeout = 60
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.FastAbort = Yes
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.InitialR2T = No
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.ImmediateData = Yes
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.FirstBurstLength = 262144
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.MaxBurstLength = 16776192
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.DefaultTime2Retain = 0
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.DefaultTime2Wait = 2
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.MaxConnections = 1
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 25 15:35:53 user nova-compute[70869]: node.session.iscsi.ERL = 0
Jul 25 15:35:53 user nova-compute[70869]: node.session.scan = manual
Jul 25 15:35:53 user nova-compute[70869]: node.session.reopen_max = 0
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].address = 172.16.0.220
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].port = 3260
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].startup = manual
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].tcp.window_size = 524288
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].tcp.type_of_service = 0
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].timeo.logout_timeout = 15
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].timeo.login_timeout = 15
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].timeo.auth_timeout = 45
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].timeo.noop_out_interval = 5
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].timeo.noop_out_timeout = 5
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].iscsi.HeaderDigest = None
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].iscsi.DataDigest = None
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].iscsi.IFMarker = No
Jul 25 15:35:53 user nova-compute[70869]: node.conn[0].iscsi.OFMarker = No
Jul 25 15:35:53 user nova-compute[70869]: # END RECORD
Jul 25 15:35:53 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b34c937-5844-4eab-b602-abf1fa563f07]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67f3c82-2822-4cee-8150-94bd7561a1c0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXMCkbBu {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXMCkbBu" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49b0c99-f9b7-4fa2-8d21-7888a31382ac]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YXMCkbBu'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[02581102-63da-4999-bb4f-28b48ee11c24]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caa9758-c508-44c2-9993-4b995a14aff5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:54 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:54 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:54 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:54 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:54 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:54 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.183s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] HCTL ('34', '0', '0', 0) found on session 17 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Successfully created port: d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e28d88-c7a8-4a19-b3d6-747151f69fde]: (4, ('0 0 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Searching for a device in session 17 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXMCkbBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.231s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] <== connect_volume: return (232ms) {'type': 'block', 'scsi_wwn': '23565323735616161', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565323735616161', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:35:54 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Instance destroyed successfully.
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-784113893',display_name='tempest-ServerStableDeviceRescueTest-server-784113893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-784113893',id=4,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZWkhEQZxma12rR0Om4x7WfDpt9pkLgXCaUDIjtRJgMe9oRuMvxIcGNqAesWThKH7m+GTrLgb/QUJ6B9QTZKJwX9sDX9n9SktFLsQ1Vx0ZmhGg8z7/yAeym8MbDarhpiw==',key_name='tempest-keypair-1975963349',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3780103999341dfa03d761707294bbd',ramdisk_id='',reservation_id='r-kjuq3luj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-464827475',owner_user_name='tempest-ServerStableDeviceRescueTest-464827475-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:33:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78b568f3a4845f081f3ceceb051ada0',uuid=fa170559-5228-448f-acea-c5b816a22631,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "vif_mac": "fa:16:3e:30:bc:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Converting VIF {"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "vif_mac": "fa:16:3e:30:bc:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=b512c720-cc12-4cbd-98b1-62b64bc2a752,network=Network(947170b3-5f57-43a6-a8a1-c3d4ae38a0e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb512c720-cc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.objects.instance [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'pci_devices' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:35:54 user nova-compute[70869]:   <uuid>fa170559-5228-448f-acea-c5b816a22631</uuid>
Jul 25 15:35:54 user nova-compute[70869]:   <name>instance-00000004</name>
Jul 25 15:35:54 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:35:54 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:35:54 user nova-compute[70869]:   <metadata>
Jul 25 15:35:54 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:35:54 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:35:54 user nova-compute[70869]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-784113893</nova:name>
Jul 25 15:35:54 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:35:53</nova:creationTime>
Jul 25 15:35:54 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:35:54 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:35:54 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:35:54 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:35:54 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:35:54 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:35:54 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:35:54 user nova-compute[70869]:       <nova:owner>
Jul 25 15:35:54 user nova-compute[70869]:         <nova:user uuid="b78b568f3a4845f081f3ceceb051ada0">tempest-ServerStableDeviceRescueTest-464827475-project-member</nova:user>
Jul 25 15:35:54 user nova-compute[70869]:         <nova:project uuid="e3780103999341dfa03d761707294bbd">tempest-ServerStableDeviceRescueTest-464827475</nova:project>
Jul 25 15:35:54 user nova-compute[70869]:       </nova:owner>
Jul 25 15:35:54 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:35:54 user nova-compute[70869]:       <nova:ports>
Jul 25 15:35:54 user nova-compute[70869]:         <nova:port uuid="b512c720-cc12-4cbd-98b1-62b64bc2a752">
Jul 25 15:35:54 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 15:35:54 user nova-compute[70869]:         </nova:port>
Jul 25 15:35:54 user nova-compute[70869]:       </nova:ports>
Jul 25 15:35:54 user nova-compute[70869]:     </nova:instance>
Jul 25 15:35:54 user nova-compute[70869]:   </metadata>
Jul 25 15:35:54 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:35:54 user nova-compute[70869]:     <system>
Jul 25 15:35:54 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:35:54 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:35:54 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:35:54 user nova-compute[70869]:       <entry name="serial">fa170559-5228-448f-acea-c5b816a22631</entry>
Jul 25 15:35:54 user nova-compute[70869]:       <entry name="uuid">fa170559-5228-448f-acea-c5b816a22631</entry>
Jul 25 15:35:54 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:35:54 user nova-compute[70869]:     </system>
Jul 25 15:35:54 user nova-compute[70869]:   </sysinfo>
Jul 25 15:35:54 user nova-compute[70869]:   <os>
Jul 25 15:35:54 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:35:54 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:35:54 user nova-compute[70869]:   </os>
Jul 25 15:35:54 user nova-compute[70869]:   <features>
Jul 25 15:35:54 user nova-compute[70869]:     <acpi/>
Jul 25 15:35:54 user nova-compute[70869]:     <apic/>
Jul 25 15:35:54 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:35:54 user nova-compute[70869]:   </features>
Jul 25 15:35:54 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:35:54 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:35:54 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:35:54 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:35:54 user nova-compute[70869]:   </clock>
Jul 25 15:35:54 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:35:54 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:35:54 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:35:54 user nova-compute[70869]:   </cpu>
Jul 25 15:35:54 user nova-compute[70869]:   <devices>
Jul 25 15:35:54 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:35:54 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:35:54 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk"/>
Jul 25 15:35:54 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:35:54 user nova-compute[70869]:     </disk>
Jul 25 15:35:54 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:35:54 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:35:54 user nova-compute[70869]:       <source dev="/dev/sdc"/>
Jul 25 15:35:54 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:35:54 user nova-compute[70869]:       <serial>cad17826-a657-4886-8a99-934a955ac72d</serial>
Jul 25 15:35:54 user nova-compute[70869]:     </disk>
Jul 25 15:35:54 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:35:54 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:35:54 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue"/>
Jul 25 15:35:54 user nova-compute[70869]:       <target dev="vdc" bus="virtio"/>
Jul 25 15:35:54 user nova-compute[70869]:       <boot order="1"/>
Jul 25 15:35:54 user nova-compute[70869]:     </disk>
Jul 25 15:35:54 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:35:54 user nova-compute[70869]:       <mac address="fa:16:3e:30:bc:ad"/>
Jul 25 15:35:54 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:35:54 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:35:54 user nova-compute[70869]:       <target dev="tapb512c720-cc"/>
Jul 25 15:35:54 user nova-compute[70869]:     </interface>
Jul 25 15:35:54 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:35:54 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/console.log" append="off"/>
Jul 25 15:35:54 user nova-compute[70869]:     </serial>
Jul 25 15:35:54 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:35:54 user nova-compute[70869]:     <video>
Jul 25 15:35:54 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:35:54 user nova-compute[70869]:     </video>
Jul 25 15:35:54 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:35:54 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:35:54 user nova-compute[70869]:     </rng>
Jul 25 15:35:54 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:35:54 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:35:54 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:35:54 user nova-compute[70869]:     </memballoon>
Jul 25 15:35:54 user nova-compute[70869]:   </devices>
Jul 25 15:35:54 user nova-compute[70869]: </domain>
Jul 25 15:35:54 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:35:54 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fa170559-5228-448f-acea-c5b816a22631] Instance destroyed successfully.
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] No VIF found with MAC fa:16:3e:30:bc:ad, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:35:54 user nova-compute[70869]: INFO nova.compute.manager [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Detaching volume 2f9c954d-f52d-4445-b157-08bf6946d203
Jul 25 15:35:54 user nova-compute[70869]: INFO nova.virt.block_device [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Attempting to driver detach volume 2f9c954d-f52d-4445-b157-08bf6946d203 from mountpoint /dev/vdb
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Attempting to detach device vdb from instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:35:54 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:35:54 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:35:54 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:35:54 user nova-compute[70869]:   <serial>2f9c954d-f52d-4445-b157-08bf6946d203</serial>
Jul 25 15:35:54 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:35:54 user nova-compute[70869]: </disk>
Jul 25 15:35:54 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:35:54 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully detached device vdb from instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 from the persistent domain config.
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epzOyBXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:54 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31bd877-34c6-4554-b4ea-a8690fd4acfc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:35:54 user nova-compute[70869]: No targets found.
Jul 25 15:35:54 user nova-compute[70869]: iSNS:
Jul 25 15:35:54 user nova-compute[70869]: No targets found.
Jul 25 15:35:54 user nova-compute[70869]: STATIC:
Jul 25 15:35:54 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d
Jul 25 15:35:54 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:54 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:54 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203
Jul 25 15:35:54 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:54 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:54 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:35:54 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:54 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:54 user nova-compute[70869]: FIRMWARE:
Jul 25 15:35:54 user nova-compute[70869]: No targets found.
Jul 25 15:35:54 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:35:54 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:35:54 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b3b56-89fc-4d9f-8d04-f705509a8734]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a70728-7888-4e71-8bbd-a5c73e696309]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:54 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:54 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:54 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:54 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:54 user nova-compute[70869]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:35:54 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe41c6e6680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a23466-17fe-454d-8db1-ee696e97edae]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad6aefb-f5fa-4669-83ff-6cf39a08d57f]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[53123014-a088-4a47-b396-baf0067664d4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e9e548-9f16-4ad3-a487-b65548d5a35e]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ec45f2-0e2b-48a9-92fc-7003fa18a381]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf6b456-4ea7-4903-aa0f-ec0c89dae0cb]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260]
Jul 25 15:35:54 user nova-compute[70869]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260] successful.
Jul 25 15:35:54 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba6a4ec-5dc4-4001-90eb-862bdb5d75f9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== disconnect_volume: return (310ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Successfully updated port: d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquired lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updating instance_info_cache with network_info: [{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Releasing lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance network_info: |[{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Start _get_guest_xml network_info=[{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:35:55 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:35:55 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1782526812',display_name='tempest-AttachVolumeTestJSON-server-1782526812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1782526812',id=17,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgx4fq1cT4MygBGosJgP3XPSWGKF3gnduqEAFmLa+F0YVFSQUPKLO96fGYOHT8HxxGd6r8xcuaJXn2eA+U3LK/s80eGJrh+hSaGuqjT1BrCFhcZworBSoltLMzly4CBDw==',key_name='tempest-keypair-660713528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-3lkej28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=00d20ec6-9f55-42f9-b4ed-6c02c9ac390f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.objects.instance [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'pci_devices' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:35:55 user nova-compute[70869]:   <uuid>00d20ec6-9f55-42f9-b4ed-6c02c9ac390f</uuid>
Jul 25 15:35:55 user nova-compute[70869]:   <name>instance-00000011</name>
Jul 25 15:35:55 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:35:55 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:35:55 user nova-compute[70869]:   <metadata>
Jul 25 15:35:55 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:35:55 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:35:55 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeTestJSON-server-1782526812</nova:name>
Jul 25 15:35:55 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:35:55</nova:creationTime>
Jul 25 15:35:55 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:35:55 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:35:55 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:35:55 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:35:55 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:35:55 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:35:55 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:35:55 user nova-compute[70869]:       <nova:owner>
Jul 25 15:35:55 user nova-compute[70869]:         <nova:user uuid="3d528e01a08f40d4b598ab8222c2edf5">tempest-AttachVolumeTestJSON-512738646-project-member</nova:user>
Jul 25 15:35:55 user nova-compute[70869]:         <nova:project uuid="d2f5d520a39742c69302f96795d0ea61">tempest-AttachVolumeTestJSON-512738646</nova:project>
Jul 25 15:35:55 user nova-compute[70869]:       </nova:owner>
Jul 25 15:35:55 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:35:55 user nova-compute[70869]:       <nova:ports>
Jul 25 15:35:55 user nova-compute[70869]:         <nova:port uuid="d545db2f-0230-400f-9bcd-e3db63ade6b6">
Jul 25 15:35:55 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 15:35:55 user nova-compute[70869]:         </nova:port>
Jul 25 15:35:55 user nova-compute[70869]:       </nova:ports>
Jul 25 15:35:55 user nova-compute[70869]:     </nova:instance>
Jul 25 15:35:55 user nova-compute[70869]:   </metadata>
Jul 25 15:35:55 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:35:55 user nova-compute[70869]:     <system>
Jul 25 15:35:55 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:35:55 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:35:55 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:35:55 user nova-compute[70869]:       <entry name="serial">00d20ec6-9f55-42f9-b4ed-6c02c9ac390f</entry>
Jul 25 15:35:55 user nova-compute[70869]:       <entry name="uuid">00d20ec6-9f55-42f9-b4ed-6c02c9ac390f</entry>
Jul 25 15:35:55 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:35:55 user nova-compute[70869]:     </system>
Jul 25 15:35:55 user nova-compute[70869]:   </sysinfo>
Jul 25 15:35:55 user nova-compute[70869]:   <os>
Jul 25 15:35:55 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:35:55 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:35:55 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:35:55 user nova-compute[70869]:   </os>
Jul 25 15:35:55 user nova-compute[70869]:   <features>
Jul 25 15:35:55 user nova-compute[70869]:     <acpi/>
Jul 25 15:35:55 user nova-compute[70869]:     <apic/>
Jul 25 15:35:55 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:35:55 user nova-compute[70869]:   </features>
Jul 25 15:35:55 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:35:55 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:35:55 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:35:55 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:35:55 user nova-compute[70869]:   </clock>
Jul 25 15:35:55 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:35:55 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:35:55 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:35:55 user nova-compute[70869]:   </cpu>
Jul 25 15:35:55 user nova-compute[70869]:   <devices>
Jul 25 15:35:55 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:35:55 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:35:55 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk"/>
Jul 25 15:35:55 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:35:55 user nova-compute[70869]:     </disk>
Jul 25 15:35:55 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:35:55 user nova-compute[70869]:       <mac address="fa:16:3e:de:f6:f9"/>
Jul 25 15:35:55 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:35:55 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:35:55 user nova-compute[70869]:       <target dev="tapd545db2f-02"/>
Jul 25 15:35:55 user nova-compute[70869]:     </interface>
Jul 25 15:35:55 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:35:55 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/console.log" append="off"/>
Jul 25 15:35:55 user nova-compute[70869]:     </serial>
Jul 25 15:35:55 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:35:55 user nova-compute[70869]:     <video>
Jul 25 15:35:55 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:35:55 user nova-compute[70869]:     </video>
Jul 25 15:35:55 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:35:55 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:35:55 user nova-compute[70869]:     </rng>
Jul 25 15:35:55 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:35:55 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:35:55 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:35:55 user nova-compute[70869]:     </memballoon>
Jul 25 15:35:55 user nova-compute[70869]:   </devices>
Jul 25 15:35:55 user nova-compute[70869]: </domain>
Jul 25 15:35:55 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1782526812',display_name='tempest-AttachVolumeTestJSON-server-1782526812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1782526812',id=17,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgx4fq1cT4MygBGosJgP3XPSWGKF3gnduqEAFmLa+F0YVFSQUPKLO96fGYOHT8HxxGd6r8xcuaJXn2eA+U3LK/s80eGJrh+hSaGuqjT1BrCFhcZworBSoltLMzly4CBDw==',key_name='tempest-keypair-660713528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-3lkej28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=00d20ec6-9f55-42f9-b4ed-6c02c9ac390f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_vif [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd545db2f-02, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd545db2f-02, col_values=(('external_ids', {'iface-id': 'd545db2f-0230-400f-9bcd-e3db63ade6b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:f6:f9', 'vm-uuid': '00d20ec6-9f55-42f9-b4ed-6c02c9ac390f'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: INFO os_vif [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02')
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No VIF found with MAC fa:16:3e:de:f6:f9, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Instance destroyed successfully.
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905910393',display_name='tempest-ServerActionsTestOtherA-server-711537279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905910393',id=5,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-on5sl0lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:35:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bf86a3b2-1ba1-490d-aef7-cbd7f17693c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_vif [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7d31348-a0, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:55 user nova-compute[70869]: INFO os_vif [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0')
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epzOyBXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:55 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eb3183-ee47-4e62-b459-02fa0bb82f15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:35:55 user nova-compute[70869]: No targets found.
Jul 25 15:35:55 user nova-compute[70869]: iSNS:
Jul 25 15:35:55 user nova-compute[70869]: No targets found.
Jul 25 15:35:55 user nova-compute[70869]: STATIC:
Jul 25 15:35:55 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d
Jul 25 15:35:55 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:55 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:55 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:35:55 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:35:55 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:35:55 user nova-compute[70869]: FIRMWARE:
Jul 25 15:35:55 user nova-compute[70869]: No targets found.
Jul 25 15:35:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:35:55 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:35:55 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ccc8f7-d0cf-461a-92b2-6aa2ff5c9ad7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7068f2-5dd2-434a-a8df-de0c45e2da64]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:55 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:35:55 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:35:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe41c6bf5b0>, {}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Disconnecting from: [] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== disconnect_volume: return (94ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:35:55 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Deleting instance files /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1_del
Jul 25 15:35:55 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Deletion of /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1_del complete
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] No waiting events found dispatching network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:55 user nova-compute[70869]: WARNING nova.compute.manager [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received unexpected event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 for instance with vm_state active and task_state rebuilding.
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-changed-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Refreshing instance network info cache due to event network-changed-d545db2f-0230-400f-9bcd-e3db63ade6b6. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] Acquiring lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] Acquired lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:35:55 user nova-compute[70869]: DEBUG nova.network.neutron [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Refreshing network info cache for port d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:35:56 user nova-compute[70869]: INFO nova.virt.block_device [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Booting with volume 2f9c954d-f52d-4445-b157-08bf6946d203 at /dev/vdb
Jul 25 15:35:56 user nova-compute[70869]: DEBUG os_brick.utils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dd772d-cfc6-41f2-8c27-1e77c5c83fb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a7d31c-ba55-4236-9e6f-2895c8c60041]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f5e58c-4b90-44dd-aa2a-6a33c9bc9a62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[506a1719-2fd7-4547-8256-6432c71a61e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:35:56 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:35:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12c4d3c-e2bd-4875-9980-bcef4a7f8e79]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG os_brick.utils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating existing volume attachment record: 32740fac-cd0f-49cb-a585-8cd72fdc4d27 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG nova.network.neutron [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updated VIF entry in instance network info cache for port d545db2f-0230-400f-9bcd-e3db63ade6b6. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG nova.network.neutron [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updating instance_info_cache with network_info: [{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-280cbe93-b3cb-4c59-880f-7e958857dc5f req-ab796edc-e440-4119-9888-62bbaaaa607d service nova] Releasing lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-05d29618-7cd3-45a1-9c05-4f220b92bcba req-23a22a2c-da8b-40b3-a132-4e87e39f0fb0 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-05d29618-7cd3-45a1-9c05-4f220b92bcba req-23a22a2c-da8b-40b3-a132-4e87e39f0fb0 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-05d29618-7cd3-45a1-9c05-4f220b92bcba req-23a22a2c-da8b-40b3-a132-4e87e39f0fb0 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-05d29618-7cd3-45a1-9c05-4f220b92bcba req-23a22a2c-da8b-40b3-a132-4e87e39f0fb0 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-05d29618-7cd3-45a1-9c05-4f220b92bcba req-23a22a2c-da8b-40b3-a132-4e87e39f0fb0 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:57 user nova-compute[70869]: WARNING nova.compute.manager [req-05d29618-7cd3-45a1-9c05-4f220b92bcba req-23a22a2c-da8b-40b3-a132-4e87e39f0fb0 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state building and task_state spawning.
Jul 25 15:35:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:58 user nova-compute[70869]: WARNING nova.compute.manager [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state active and task_state rescuing.
Jul 25 15:35:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:58 user nova-compute[70869]: WARNING nova.compute.manager [req-4b4345e6-79e1-4e10-9d40-f221d6fd1f27 req-115c6419-c0a7-4d86-8230-173e3d65d801 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state active and task_state rescuing.
Jul 25 15:35:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for fa170559-5228-448f-acea-c5b816a22631 due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299359.2699535, fa170559-5228-448f-acea-c5b816a22631 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] VM Resumed (Lifecycle Event)
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-37eecf29-4a06-4ab8-bc89-dff270a9437c tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:35:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299359.27491, fa170559-5228-448f-acea-c5b816a22631 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] VM Started (Lifecycle Event)
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-b0b722ff-abfa-41ff-8e6f-9269ae5e7cf6 req-4b02c53b-88ef-4d5c-a174-109d1d51d8fe service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b0b722ff-abfa-41ff-8e6f-9269ae5e7cf6 req-4b02c53b-88ef-4d5c-a174-109d1d51d8fe service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b0b722ff-abfa-41ff-8e6f-9269ae5e7cf6 req-4b02c53b-88ef-4d5c-a174-109d1d51d8fe service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b0b722ff-abfa-41ff-8e6f-9269ae5e7cf6 req-4b02c53b-88ef-4d5c-a174-109d1d51d8fe service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-b0b722ff-abfa-41ff-8e6f-9269ae5e7cf6 req-4b02c53b-88ef-4d5c-a174-109d1d51d8fe service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:35:59 user nova-compute[70869]: WARNING nova.compute.manager [req-b0b722ff-abfa-41ff-8e6f-9269ae5e7cf6 req-4b02c53b-88ef-4d5c-a174-109d1d51d8fe service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state building and task_state spawning.
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299359.90088, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] VM Resumed (Lifecycle Event)
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:35:59 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance spawned successfully.
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:35:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299359.9067965, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:35:59 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] VM Started (Lifecycle Event)
Jul 25 15:35:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:36:00 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:36:00 user nova-compute[70869]: INFO nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Took 7.08 seconds to spawn the instance on the hypervisor.
Jul 25 15:36:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:00 user nova-compute[70869]: INFO nova.compute.manager [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Took 9.62 seconds to build instance.
Jul 25 15:36:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-bea4614c-32f5-4989-8b6e-0c7046e5fa69 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.739s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:02 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299347.7665575, 3b38a39b-5ad8-4341-b132-597b8ab6a849 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:36:02 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] VM Stopped (Lifecycle Event)
Jul 25 15:36:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c71da2be-f396-4d4a-86c3-3307258cc0fa None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:03 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299348.1442585, 3a84f092-352e-4039-8dcb-bd4578458765 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:36:03 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] VM Stopped (Lifecycle Event)
Jul 25 15:36:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:03 user nova-compute[70869]: DEBUG nova.compute.manager [None req-29caeedb-34d4-4d3c-b3e7-889bf18040cb None None] [instance: 3a84f092-352e-4039-8dcb-bd4578458765] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:03 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:36:03 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Creating image(s)
Jul 25 15:36:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk 1073741824" returned: 0 in 0.052s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.165s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Cannot resize image /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Ensure instance console log exists: /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Start _get_guest_xml network_info=[{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '32740fac-cd0f-49cb-a585-8cd72fdc4d27', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epzOyBXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf86a3b2-1ba1-490d-aef7-cbd7f17693c1', 'attached_at': '', 'detached_at': '', 'volume_id': '2f9c954d-f52d-4445-b157-08bf6946d203', 'serial': '2f9c954d-f52d-4445-b157-08bf6946d203'}, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:36:04 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 15:36:04 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epzOyBXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:36:04 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:36:04 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:36:04 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3013015-5512-4105-8592-4c10831d5e7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:36:04 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[484861d3-57e6-4ae4-bc19-cb91bccfca04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203] added
Jul 25 15:36:04 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6833a9eb-7f1b-463b-8f7e-d35cc8648f48]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a9c352-4fb3-4fb7-bfb4-8999c31413b0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epzOyBXL {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epzOyBXL" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60a9daf-dd7a-4b6a-bcc9-74dc5decd821]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epzOyBXL'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e5660a-719c-4fdc-9ca6-2b721cdaaaf4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7c9892-0d6e-41e9-afe8-75718e087e51]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:05 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:05 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b03f18d-361d-4d65-9f34-923b82aebc8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260]
Jul 25 15:36:05 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260] successful.
Jul 25 15:36:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9e95af-e558-4329-a4d9-07849911411a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217816e-5ce3-4c0e-bd86-0527239190f0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:05 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:05 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:36:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:05 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:05 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:36:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb159e7-e241-4f96-80be-492c35d9b03c]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epzOyBXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:36:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23737343864323636', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737343864323636', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905910393',display_name='tempest-ServerActionsTestOtherA-server-711537279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905910393',id=5,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-on5sl0lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bf86a3b2-1ba1-490d-aef7-cbd7f17693c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:36:06 user nova-compute[70869]:   <uuid>bf86a3b2-1ba1-490d-aef7-cbd7f17693c1</uuid>
Jul 25 15:36:06 user nova-compute[70869]:   <name>instance-00000005</name>
Jul 25 15:36:06 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:36:06 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:36:06 user nova-compute[70869]:   <metadata>
Jul 25 15:36:06 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:36:06 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:36:06 user nova-compute[70869]:       <nova:name>tempest-ServerActionsTestOtherA-server-711537279</nova:name>
Jul 25 15:36:06 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:36:04</nova:creationTime>
Jul 25 15:36:06 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:36:06 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:36:06 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:36:06 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:36:06 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:36:06 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:36:06 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:36:06 user nova-compute[70869]:       <nova:owner>
Jul 25 15:36:06 user nova-compute[70869]:         <nova:user uuid="3d09efb7dac2429a97ec41381705c5a5">tempest-ServerActionsTestOtherA-798279085-project-member</nova:user>
Jul 25 15:36:06 user nova-compute[70869]:         <nova:project uuid="f52ab59c5e0a442aa53ad1edd6b4ec5e">tempest-ServerActionsTestOtherA-798279085</nova:project>
Jul 25 15:36:06 user nova-compute[70869]:       </nova:owner>
Jul 25 15:36:06 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:36:06 user nova-compute[70869]:       <nova:ports>
Jul 25 15:36:06 user nova-compute[70869]:         <nova:port uuid="b7d31348-a01c-40f7-993c-e350d788f767">
Jul 25 15:36:06 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 15:36:06 user nova-compute[70869]:         </nova:port>
Jul 25 15:36:06 user nova-compute[70869]:       </nova:ports>
Jul 25 15:36:06 user nova-compute[70869]:     </nova:instance>
Jul 25 15:36:06 user nova-compute[70869]:   </metadata>
Jul 25 15:36:06 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:36:06 user nova-compute[70869]:     <system>
Jul 25 15:36:06 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:36:06 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:36:06 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:36:06 user nova-compute[70869]:       <entry name="serial">bf86a3b2-1ba1-490d-aef7-cbd7f17693c1</entry>
Jul 25 15:36:06 user nova-compute[70869]:       <entry name="uuid">bf86a3b2-1ba1-490d-aef7-cbd7f17693c1</entry>
Jul 25 15:36:06 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:36:06 user nova-compute[70869]:     </system>
Jul 25 15:36:06 user nova-compute[70869]:   </sysinfo>
Jul 25 15:36:06 user nova-compute[70869]:   <os>
Jul 25 15:36:06 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:36:06 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:36:06 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:36:06 user nova-compute[70869]:   </os>
Jul 25 15:36:06 user nova-compute[70869]:   <features>
Jul 25 15:36:06 user nova-compute[70869]:     <acpi/>
Jul 25 15:36:06 user nova-compute[70869]:     <apic/>
Jul 25 15:36:06 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:36:06 user nova-compute[70869]:   </features>
Jul 25 15:36:06 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:36:06 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:36:06 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:36:06 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:36:06 user nova-compute[70869]:   </clock>
Jul 25 15:36:06 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:36:06 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:36:06 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:36:06 user nova-compute[70869]:   </cpu>
Jul 25 15:36:06 user nova-compute[70869]:   <devices>
Jul 25 15:36:06 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:36:06 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:36:06 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk"/>
Jul 25 15:36:06 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:36:06 user nova-compute[70869]:     </disk>
Jul 25 15:36:06 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:36:06 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:36:06 user nova-compute[70869]:       <source dev="/dev/sdd"/>
Jul 25 15:36:06 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:36:06 user nova-compute[70869]:       <serial>2f9c954d-f52d-4445-b157-08bf6946d203</serial>
Jul 25 15:36:06 user nova-compute[70869]:     </disk>
Jul 25 15:36:06 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:36:06 user nova-compute[70869]:       <mac address="fa:16:3e:51:e8:f2"/>
Jul 25 15:36:06 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:36:06 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:36:06 user nova-compute[70869]:       <target dev="tapb7d31348-a0"/>
Jul 25 15:36:06 user nova-compute[70869]:     </interface>
Jul 25 15:36:06 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:36:06 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/console.log" append="off"/>
Jul 25 15:36:06 user nova-compute[70869]:     </serial>
Jul 25 15:36:06 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:36:06 user nova-compute[70869]:     <video>
Jul 25 15:36:06 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:36:06 user nova-compute[70869]:     </video>
Jul 25 15:36:06 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:36:06 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:36:06 user nova-compute[70869]:     </rng>
Jul 25 15:36:06 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:36:06 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:36:06 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:36:06 user nova-compute[70869]:     </memballoon>
Jul 25 15:36:06 user nova-compute[70869]:   </devices>
Jul 25 15:36:06 user nova-compute[70869]: </domain>
Jul 25 15:36:06 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905910393',display_name='tempest-ServerActionsTestOtherA-server-711537279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905910393',id=5,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-on5sl0lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bf86a3b2-1ba1-490d-aef7-cbd7f17693c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG os_vif [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7d31348-a0, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7d31348-a0, col_values=(('external_ids', {'iface-id': 'b7d31348-a01c-40f7-993c-e350d788f767', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:e8:f2', 'vm-uuid': 'bf86a3b2-1ba1-490d-aef7-cbd7f17693c1'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:06 user nova-compute[70869]: INFO os_vif [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0')
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:36:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No VIF found with MAC fa:16:3e:51:e8:f2, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:36:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-bce2e5cf-4e0c-4c42-9a14-ceeadc735a69 req-824bf863-0361-4136-9d7a-5c9b1f60782f service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:36:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bce2e5cf-4e0c-4c42-9a14-ceeadc735a69 req-824bf863-0361-4136-9d7a-5c9b1f60782f service nova] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bce2e5cf-4e0c-4c42-9a14-ceeadc735a69 req-824bf863-0361-4136-9d7a-5c9b1f60782f service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bce2e5cf-4e0c-4c42-9a14-ceeadc735a69 req-824bf863-0361-4136-9d7a-5c9b1f60782f service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-bce2e5cf-4e0c-4c42-9a14-ceeadc735a69 req-824bf863-0361-4136-9d7a-5c9b1f60782f service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] No waiting events found dispatching network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:36:08 user nova-compute[70869]: WARNING nova.compute.manager [req-bce2e5cf-4e0c-4c42-9a14-ceeadc735a69 req-824bf863-0361-4136-9d7a-5c9b1f60782f service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received unexpected event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 for instance with vm_state active and task_state rebuild_spawning.
Jul 25 15:36:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:09 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299354.1127055, bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:36:09 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] VM Stopped (Lifecycle Event)
Jul 25 15:36:09 user nova-compute[70869]: DEBUG nova.compute.manager [None req-dafea98f-e6a4-4f09-bec1-69c3ec639461 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-66ea14c9-2934-4d8f-b260-282244adcefb req-c96ecfbf-bcd0-43e7-be82-1f1a8904ab35 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-66ea14c9-2934-4d8f-b260-282244adcefb req-c96ecfbf-bcd0-43e7-be82-1f1a8904ab35 service nova] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-66ea14c9-2934-4d8f-b260-282244adcefb req-c96ecfbf-bcd0-43e7-be82-1f1a8904ab35 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-66ea14c9-2934-4d8f-b260-282244adcefb req-c96ecfbf-bcd0-43e7-be82-1f1a8904ab35 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-66ea14c9-2934-4d8f-b260-282244adcefb req-c96ecfbf-bcd0-43e7-be82-1f1a8904ab35 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] No waiting events found dispatching network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:36:10 user nova-compute[70869]: WARNING nova.compute.manager [req-66ea14c9-2934-4d8f-b260-282244adcefb req-c96ecfbf-bcd0-43e7-be82-1f1a8904ab35 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received unexpected event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 for instance with vm_state active and task_state rebuild_spawning.
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299370.3199222, bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:36:10 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] VM Resumed (Lifecycle Event)
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Instance spawned successfully.
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:36:10 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299370.3203073, bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:36:10 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] VM Started (Lifecycle Event)
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:10 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 15:36:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70869) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 15:36:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e24d4a4-ff8f-43f6-a885-a6c70e2908a1 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-dd448cee-f129-471e-9278-565e33d869f8 req-3d23ef91-9f14-42dc-ab5e-0cd4807c3c6f service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event volume-reimaged-1fab0f90-3418-4b93-b8dd-d2bd164db283 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dd448cee-f129-471e-9278-565e33d869f8 req-3d23ef91-9f14-42dc-ab5e-0cd4807c3c6f service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dd448cee-f129-471e-9278-565e33d869f8 req-3d23ef91-9f14-42dc-ab5e-0cd4807c3c6f service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dd448cee-f129-471e-9278-565e33d869f8 req-3d23ef91-9f14-42dc-ab5e-0cd4807c3c6f service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-dd448cee-f129-471e-9278-565e33d869f8 req-3d23ef91-9f14-42dc-ab5e-0cd4807c3c6f service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Processing event volume-reimaged-1fab0f90-3418-4b93-b8dd-d2bd164db283 {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10772}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance event wait completed in 24 seconds for volume-reimaged {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:36:15 user nova-compute[70869]: INFO nova.virt.block_device [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Booting with volume 1fab0f90-3418-4b93-b8dd-d2bd164db283 at /dev/vda
Jul 25 15:36:15 user nova-compute[70869]: DEBUG os_brick.utils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cc8b2e-e917-4869-8fa0-d4624fb5922c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[912490f4-5e20-42ef-a660-f90cd8047c35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5008a93-c4b5-4725-a845-d9a08710e9f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83d9d18-84d6-4306-a6e6-0b2b0c342774]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:36:15 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:36:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a12282b-9761-4bd6-8233-393f6b90bb4d]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG os_brick.utils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:36:15 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Updating existing volume attachment record: d28ac2fe-2c9c-4fea-a011-564c123cee8e {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:36:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:36:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Creating image(s)
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Ensure instance console log exists: /opt/stack/data/nova/instances/3b38a39b-5ad8-4341-b132-597b8ab6a849/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Start _get_guest_xml network_info=[{"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd28ac2fe-2c9c-4fea-a011-564c123cee8e', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awASrUZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b38a39b-5ad8-4341-b132-597b8ab6a849', 'attached_at': '', 'detached_at': '', 'volume_id': '1fab0f90-3418-4b93-b8dd-d2bd164db283', 'serial': '1fab0f90-3418-4b93-b8dd-d2bd164db283'}, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:36:25 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 15:36:25 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:36:25 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b38a39b-5ad8-4341-b132-597b8ab6a849 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awASrUZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:36:26 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:36:26 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:36:26 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d08874-2a40-4169-a4ef-f8050dcef9be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:36:26 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5a0d3f-ce6a-4102-8ade-f208d1041c05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283] added
Jul 25 15:36:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeb22ca-3484-4f95-8a16-b5ec89dbae0b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc30ce8-68ea-4627-bbae-9ae266b219dd]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awASrUZC {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awASrUZC" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68706c9-0f82-4869-a6a6-4741ad431d18]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awASrUZC'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c75c9c7-6c47-46d2-a633-38686bf12949]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e38527-6899-471a-b319-47d24e13cb7b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:36:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:36:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a8891e-e1a6-4606-8083-0c12c3385cb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260]
Jul 25 15:36:26 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260] successful.
Jul 25 15:36:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e652689-53a8-4a2f-a446-a7d8c7067691]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d0b7d2-678a-424e-9622-003f3609db3e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:36:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:36:26 user nova-compute[70869]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:36:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1a76c3-5f64-4033-8218-796f90a58713]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awASrUZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:36:26 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26164376234373239', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164376234373239', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-779221569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-805847803',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkVAmxmlz9/k5ZXxC76vtVdp+U7q5KzaQBmndoNBkWoKxXxqljSS1jb5uYAjGuvcLIZ8lDA73m2VNNzORpITL5U/MKWIHqpe2k7cYW8WX1atjyqJ4EsYC2Jah+XtUpLw==',key_name='tempest-keypair-1784292135',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:34:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='27d4e6ad84894e2d8ca5aee1aa77db4e',ramdisk_id='',reservation_id='r-0fnuttbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1601506810',owner_user_name='tempest-ServerActionsV293TestJSON-1601506810-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0d6af7f176145f382a7cc839ed2c027',uuid=3b38a39b-5ad8-4341-b132-597b8ab6a849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converting VIF {"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:36:27 user nova-compute[70869]:   <uuid>3b38a39b-5ad8-4341-b132-597b8ab6a849</uuid>
Jul 25 15:36:27 user nova-compute[70869]:   <name>instance-0000000e</name>
Jul 25 15:36:27 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:36:27 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:36:27 user nova-compute[70869]:   <metadata>
Jul 25 15:36:27 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:36:27 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:36:27 user nova-compute[70869]:       <nova:name>tempest-ServerActionsV293TestJSON-server-779221569</nova:name>
Jul 25 15:36:27 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:36:25</nova:creationTime>
Jul 25 15:36:27 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:36:27 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:36:27 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:36:27 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:36:27 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:36:27 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:36:27 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:36:27 user nova-compute[70869]:       <nova:owner>
Jul 25 15:36:27 user nova-compute[70869]:         <nova:user uuid="d0d6af7f176145f382a7cc839ed2c027">tempest-ServerActionsV293TestJSON-1601506810-project-member</nova:user>
Jul 25 15:36:27 user nova-compute[70869]:         <nova:project uuid="27d4e6ad84894e2d8ca5aee1aa77db4e">tempest-ServerActionsV293TestJSON-1601506810</nova:project>
Jul 25 15:36:27 user nova-compute[70869]:       </nova:owner>
Jul 25 15:36:27 user nova-compute[70869]:       <nova:ports>
Jul 25 15:36:27 user nova-compute[70869]:         <nova:port uuid="7bde5f26-2d7a-4e3e-adff-311873ad7a87">
Jul 25 15:36:27 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 15:36:27 user nova-compute[70869]:         </nova:port>
Jul 25 15:36:27 user nova-compute[70869]:       </nova:ports>
Jul 25 15:36:27 user nova-compute[70869]:     </nova:instance>
Jul 25 15:36:27 user nova-compute[70869]:   </metadata>
Jul 25 15:36:27 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:36:27 user nova-compute[70869]:     <system>
Jul 25 15:36:27 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:36:27 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:36:27 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:36:27 user nova-compute[70869]:       <entry name="serial">3b38a39b-5ad8-4341-b132-597b8ab6a849</entry>
Jul 25 15:36:27 user nova-compute[70869]:       <entry name="uuid">3b38a39b-5ad8-4341-b132-597b8ab6a849</entry>
Jul 25 15:36:27 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:36:27 user nova-compute[70869]:     </system>
Jul 25 15:36:27 user nova-compute[70869]:   </sysinfo>
Jul 25 15:36:27 user nova-compute[70869]:   <os>
Jul 25 15:36:27 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:36:27 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:36:27 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:36:27 user nova-compute[70869]:   </os>
Jul 25 15:36:27 user nova-compute[70869]:   <features>
Jul 25 15:36:27 user nova-compute[70869]:     <acpi/>
Jul 25 15:36:27 user nova-compute[70869]:     <apic/>
Jul 25 15:36:27 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:36:27 user nova-compute[70869]:   </features>
Jul 25 15:36:27 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:36:27 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:36:27 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:36:27 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:36:27 user nova-compute[70869]:   </clock>
Jul 25 15:36:27 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:36:27 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:36:27 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:36:27 user nova-compute[70869]:   </cpu>
Jul 25 15:36:27 user nova-compute[70869]:   <devices>
Jul 25 15:36:27 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:36:27 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:36:27 user nova-compute[70869]:       <source dev="/dev/sde"/>
Jul 25 15:36:27 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:36:27 user nova-compute[70869]:       <serial>1fab0f90-3418-4b93-b8dd-d2bd164db283</serial>
Jul 25 15:36:27 user nova-compute[70869]:     </disk>
Jul 25 15:36:27 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:36:27 user nova-compute[70869]:       <mac address="fa:16:3e:08:25:0f"/>
Jul 25 15:36:27 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:36:27 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:36:27 user nova-compute[70869]:       <target dev="tap7bde5f26-2d"/>
Jul 25 15:36:27 user nova-compute[70869]:     </interface>
Jul 25 15:36:27 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:36:27 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/3b38a39b-5ad8-4341-b132-597b8ab6a849/console.log" append="off"/>
Jul 25 15:36:27 user nova-compute[70869]:     </serial>
Jul 25 15:36:27 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:36:27 user nova-compute[70869]:     <video>
Jul 25 15:36:27 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:36:27 user nova-compute[70869]:     </video>
Jul 25 15:36:27 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:36:27 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:36:27 user nova-compute[70869]:     </rng>
Jul 25 15:36:27 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:36:27 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:36:27 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:36:27 user nova-compute[70869]:     </memballoon>
Jul 25 15:36:27 user nova-compute[70869]:   </devices>
Jul 25 15:36:27 user nova-compute[70869]: </domain>
Jul 25 15:36:27 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-779221569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-805847803',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkVAmxmlz9/k5ZXxC76vtVdp+U7q5KzaQBmndoNBkWoKxXxqljSS1jb5uYAjGuvcLIZ8lDA73m2VNNzORpITL5U/MKWIHqpe2k7cYW8WX1atjyqJ4EsYC2Jah+XtUpLw==',key_name='tempest-keypair-1784292135',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:34:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='27d4e6ad84894e2d8ca5aee1aa77db4e',ramdisk_id='',reservation_id='r-0fnuttbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1601506810',owner_user_name='tempest-ServerActionsV293TestJSON-1601506810-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0d6af7f176145f382a7cc839ed2c027',uuid=3b38a39b-5ad8-4341-b132-597b8ab6a849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converting VIF {"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG os_vif [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bde5f26-2d, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7bde5f26-2d, col_values=(('external_ids', {'iface-id': '7bde5f26-2d7a-4e3e-adff-311873ad7a87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:25:0f', 'vm-uuid': '3b38a39b-5ad8-4341-b132-597b8ab6a849'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:27 user nova-compute[70869]: INFO os_vif [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d')
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] No VIF found with MAC fa:16:3e:08:25:0f, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating instance_info_cache with network_info: [{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:36:27 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:36:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:29 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:36:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-963857b2-97c6-4d73-832d-3ab45bc6d0e1 req-51e70433-d0e1-4bb7-a179-143659be354c service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:36:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-963857b2-97c6-4d73-832d-3ab45bc6d0e1 req-51e70433-d0e1-4bb7-a179-143659be354c service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-963857b2-97c6-4d73-832d-3ab45bc6d0e1 req-51e70433-d0e1-4bb7-a179-143659be354c service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-963857b2-97c6-4d73-832d-3ab45bc6d0e1 req-51e70433-d0e1-4bb7-a179-143659be354c service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-963857b2-97c6-4d73-832d-3ab45bc6d0e1 req-51e70433-d0e1-4bb7-a179-143659be354c service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No waiting events found dispatching network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:36:30 user nova-compute[70869]: WARNING nova.compute.manager [req-963857b2-97c6-4d73-832d-3ab45bc6d0e1 req-51e70433-d0e1-4bb7-a179-143659be354c service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state active and task_state rebuild_spawning.
Jul 25 15:36:30 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:36:30 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:36:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299391.508119, 3b38a39b-5ad8-4341-b132-597b8ab6a849 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:36:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] VM Resumed (Lifecycle Event)
Jul 25 15:36:31 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance spawned successfully.
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:36:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299391.5117176, 3b38a39b-5ad8-4341-b132-597b8ab6a849 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:36:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] VM Started (Lifecycle Event)
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:36:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70869) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dd448cee-f129-471e-9278-565e33d869f8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.096s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.039s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.010s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:31 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-b925a166-bec6-43ec-a879-e0ac57d0a151 req-2f8c29f1-19bd-4da4-9fd4-c4658fc64609 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b925a166-bec6-43ec-a879-e0ac57d0a151 req-2f8c29f1-19bd-4da4-9fd4-c4658fc64609 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b925a166-bec6-43ec-a879-e0ac57d0a151 req-2f8c29f1-19bd-4da4-9fd4-c4658fc64609 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b925a166-bec6-43ec-a879-e0ac57d0a151 req-2f8c29f1-19bd-4da4-9fd4-c4658fc64609 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-b925a166-bec6-43ec-a879-e0ac57d0a151 req-2f8c29f1-19bd-4da4-9fd4-c4658fc64609 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No waiting events found dispatching network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:36:32 user nova-compute[70869]: WARNING nova.compute.manager [req-b925a166-bec6-43ec-a879-e0ac57d0a151 req-2f8c29f1-19bd-4da4-9fd4-c4658fc64609 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state active and task_state None.
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:34 user nova-compute[70869]: INFO nova.compute.manager [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Rescuing
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquired lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:36:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updating instance_info_cache with network_info: [{"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Releasing lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-ca84e2f6-ea27-4cb6-8c88-39364805d1c0 req-621f0edf-cbb0-45f2-844f-1dabcf96619a service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-unplugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ca84e2f6-ea27-4cb6-8c88-39364805d1c0 req-621f0edf-cbb0-45f2-844f-1dabcf96619a service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ca84e2f6-ea27-4cb6-8c88-39364805d1c0 req-621f0edf-cbb0-45f2-844f-1dabcf96619a service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ca84e2f6-ea27-4cb6-8c88-39364805d1c0 req-621f0edf-cbb0-45f2-844f-1dabcf96619a service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.manager [req-ca84e2f6-ea27-4cb6-8c88-39364805d1c0 req-621f0edf-cbb0-45f2-844f-1dabcf96619a service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-unplugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:36:36 user nova-compute[70869]: WARNING nova.compute.manager [req-ca84e2f6-ea27-4cb6-8c88-39364805d1c0 req-621f0edf-cbb0-45f2-844f-1dabcf96619a service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-unplugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state active and task_state rescuing.
Jul 25 15:36:36 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Instance destroyed successfully.
Jul 25 15:36:36 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:36:36 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7384MB free_disk=25.611717224121094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:36 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Attempting a stable device rescue
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70869) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Instance directory exists: not creating {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 15:36:36 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Creating image(s)
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "/opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "/opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "/opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'trusted_certs' on Instance uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "fec04bebf09c5d870deb5dbf323e0cb2985a408e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "fec04bebf09c5d870deb5dbf323e0cb2985a408e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fa170559-5228-448f-acea-c5b816a22631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 08fa2836-717a-4893-8969-fcab677935a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3b38a39b-5ad8-4341-b132-597b8ab6a849 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:36:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-356e8148-03ee-4eb0-9259-a15118635980 req-6b5cbffc-9ba7-4b82-93bd-b30dac817149 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-356e8148-03ee-4eb0-9259-a15118635980 req-6b5cbffc-9ba7-4b82-93bd-b30dac817149 service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-356e8148-03ee-4eb0-9259-a15118635980 req-6b5cbffc-9ba7-4b82-93bd-b30dac817149 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-356e8148-03ee-4eb0-9259-a15118635980 req-6b5cbffc-9ba7-4b82-93bd-b30dac817149 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-356e8148-03ee-4eb0-9259-a15118635980 req-6b5cbffc-9ba7-4b82-93bd-b30dac817149 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:36:38 user nova-compute[70869]: WARNING nova.compute.manager [req-356e8148-03ee-4eb0-9259-a15118635980 req-6b5cbffc-9ba7-4b82-93bd-b30dac817149 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state active and task_state rescuing.
Jul 25 15:36:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e.part --force-share --output=json" returned: 0 in 0.208s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG nova.virt.images [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] 6e535f25-3148-4486-898c-1897a396a795 was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e.part /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e.part /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e.converted" returned: 0 in 0.225s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "fec04bebf09c5d870deb5dbf323e0cb2985a408e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.963s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "fec04bebf09c5d870deb5dbf323e0cb2985a408e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "fec04bebf09c5d870deb5dbf323e0cb2985a408e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:36:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.119s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e --force-share --output=json" returned: 0 in 0.277s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e,backing_fmt=raw /opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.rescue {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e,backing_fmt=raw /opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.rescue" returned: 0 in 0.054s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "fec04bebf09c5d870deb5dbf323e0cb2985a408e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'migration_context' on Instance uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Start _get_guest_xml network_info=[{"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "vif_mac": "fa:16:3e:4d:77:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6e535f25-3148-4486-898c-1897a396a795', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b4fd0aba-7f4a-4671-9fb8-cc933ae4c8fc', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgmhefxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a525e472-1e7b-40b5-a4b1-5ba8bae313c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 'serial': 'a7d4a3f2-1140-4be4-a32c-a56b6661a89e'}, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'resources' on Instance uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'numa_topology' on Instance uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:36:39 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:36:39 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'vcpu_model' on Instance uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgmhefxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:36:39 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:36:39 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:36:39 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24196802-6ca4-4470-9b61-113c7636beea]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = FgmhefxQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 25 15:36:39 user nova-compute[70869]: node.name = iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:36:39 user nova-compute[70869]: node.tpgt = -1
Jul 25 15:36:39 user nova-compute[70869]: node.startup = automatic
Jul 25 15:36:39 user nova-compute[70869]: node.leading_login = No
Jul 25 15:36:39 user nova-compute[70869]: iface.iscsi_ifacename = default
Jul 25 15:36:39 user nova-compute[70869]: iface.net_ifacename = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.ipaddress = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.prefix_len = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.hwaddress = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.transport_name = tcp
Jul 25 15:36:39 user nova-compute[70869]: iface.initiatorname = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.state = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.vlan_id = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.vlan_priority = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.vlan_state = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.iface_num = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.mtu = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.port = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.bootproto = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.subnet_mask = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.gateway = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.dhcp_alt_client_id_state = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.dhcp_alt_client_id = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.dhcp_dns = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.dhcp_learn_iqn = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.dhcp_req_vendor_id_state = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.dhcp_vendor_id_state = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.dhcp_vendor_id = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.dhcp_slp_da = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.fragmentation = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.gratuitous_arp = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.incoming_forwarding = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.tos_state = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.tos = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.ttl = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.delayed_ack = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.tcp_nagle = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.tcp_wsf_state = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.tcp_wsf = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.tcp_timer_scale = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.tcp_timestamp = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.redirect = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.def_task_mgmt_timeout = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.header_digest = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.data_digest = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.immediate_data = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.initial_r2t = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.data_seq_inorder = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.data_pdu_inorder = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.erl = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.max_receive_data_len = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.first_burst_len = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.max_outstanding_r2t = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.max_burst_len = 0
Jul 25 15:36:39 user nova-compute[70869]: iface.chap_auth = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.bidi_chap = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.strict_login_compliance = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.discovery_auth = <empty>
Jul 25 15:36:39 user nova-compute[70869]: iface.discovery_logout = <empty>
Jul 25 15:36:39 user nova-compute[70869]: node.discovery_address = <empty>
Jul 25 15:36:39 user nova-compute[70869]: node.discovery_port = 0
Jul 25 15:36:39 user nova-compute[70869]: node.discovery_type = static
Jul 25 15:36:39 user nova-compute[70869]: node.session.initial_cmdsn = 0
Jul 25 15:36:39 user nova-compute[70869]: node.session.initial_login_retry_max = 8
Jul 25 15:36:39 user nova-compute[70869]: node.session.xmit_thread_priority = -20
Jul 25 15:36:39 user nova-compute[70869]: node.session.cmds_max = 128
Jul 25 15:36:39 user nova-compute[70869]: node.session.queue_depth = 32
Jul 25 15:36:39 user nova-compute[70869]: node.session.nr_sessions = 1
Jul 25 15:36:39 user nova-compute[70869]: node.session.auth.authmethod = CHAP
Jul 25 15:36:39 user nova-compute[70869]: node.session.auth.username = FgmhefxQ
Jul 25 15:36:39 user nova-compute[70869]: node.session.auth.password = ***
Jul 25 15:36:39 user nova-compute[70869]: node.session.auth.username_in = <empty>
Jul 25 15:36:39 user nova-compute[70869]: node.session.auth.password_in = <empty>
Jul 25 15:36:39 user nova-compute[70869]: node.session.auth.chap_algs = MD5
Jul 25 15:36:39 user nova-compute[70869]: node.session.timeo.replacement_timeout = 120
Jul 25 15:36:39 user nova-compute[70869]: node.session.err_timeo.abort_timeout = 15
Jul 25 15:36:39 user nova-compute[70869]: node.session.err_timeo.lu_reset_timeout = 30
Jul 25 15:36:39 user nova-compute[70869]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 25 15:36:39 user nova-compute[70869]: node.session.err_timeo.host_reset_timeout = 60
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.FastAbort = Yes
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.InitialR2T = No
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.ImmediateData = Yes
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.FirstBurstLength = 262144
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.MaxBurstLength = 16776192
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.DefaultTime2Retain = 0
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.DefaultTime2Wait = 2
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.MaxConnections = 1
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 25 15:36:39 user nova-compute[70869]: node.session.iscsi.ERL = 0
Jul 25 15:36:39 user nova-compute[70869]: node.session.scan = manual
Jul 25 15:36:39 user nova-compute[70869]: node.session.reopen_max = 0
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].address = 172.16.0.220
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].port = 3260
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].startup = manual
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].tcp.window_size = 524288
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].tcp.type_of_service = 0
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].timeo.logout_timeout = 15
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].timeo.login_timeout = 15
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].timeo.auth_timeout = 45
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].timeo.noop_out_interval = 5
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].timeo.noop_out_timeout = 5
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].iscsi.HeaderDigest = None
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].iscsi.DataDigest = None
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].iscsi.IFMarker = No
Jul 25 15:36:39 user nova-compute[70869]: node.conn[0].iscsi.OFMarker = No
Jul 25 15:36:39 user nova-compute[70869]: # END RECORD
Jul 25 15:36:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be70cd3-3455-4330-abd9-a52d97feadc0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5cb269-295c-4e5d-b7ec-402b340c19ad]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgmhefxQ {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgmhefxQ" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb90ac0-ec44-4473-bb3a-ace3f784705c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FgmhefxQ'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff21d8c0-4c8a-4d2d-9a00-438080a6979b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ab1d23-6f13-498a-b8ec-39269a23e4fd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:39 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:39 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:36:39 user nova-compute[70869]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:36:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:36:39 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:36:39 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:36:39 user nova-compute[70869]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:36:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.190s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7955565a-782f-4e76-9f43-6a5223fee78a]: (4, ('0 0 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgmhefxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.221s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] <== connect_volume: return (222ms) {'type': 'block', 'scsi_wwn': '26262633339626564', 'path': '/dev/sdb'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262633339626564', 'path': '/dev/sdb'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1613461442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1613461442',id=15,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:35:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-1kc1pjj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:35:05Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=a525e472-1e7b-40b5-a4b1-5ba8bae313c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "vif_mac": "fa:16:3e:4d:77:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "vif_mac": "fa:16:3e:4d:77:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:77:eb,bridge_name='br-int',has_traffic_filtering=True,id=f433efca-963a-44ce-99c2-b1c4488c564a,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf433efca-96') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'pci_devices' on Instance uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:36:39 user nova-compute[70869]:   <uuid>a525e472-1e7b-40b5-a4b1-5ba8bae313c9</uuid>
Jul 25 15:36:39 user nova-compute[70869]:   <name>instance-0000000f</name>
Jul 25 15:36:39 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:36:39 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:36:39 user nova-compute[70869]:   <metadata>
Jul 25 15:36:39 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:36:39 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:36:39 user nova-compute[70869]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1613461442</nova:name>
Jul 25 15:36:39 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:36:39</nova:creationTime>
Jul 25 15:36:39 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:36:39 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:36:39 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:36:39 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:36:39 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:36:39 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:36:39 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:36:39 user nova-compute[70869]:       <nova:owner>
Jul 25 15:36:39 user nova-compute[70869]:         <nova:user uuid="02dfa618b8fc4b06b5e396b7da9e8443">tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member</nova:user>
Jul 25 15:36:39 user nova-compute[70869]:         <nova:project uuid="3735c3192f424a8abee7c1874609f005">tempest-ServerBootFromVolumeStableRescueTest-508290498</nova:project>
Jul 25 15:36:39 user nova-compute[70869]:       </nova:owner>
Jul 25 15:36:39 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:36:39 user nova-compute[70869]:       <nova:ports>
Jul 25 15:36:39 user nova-compute[70869]:         <nova:port uuid="f433efca-963a-44ce-99c2-b1c4488c564a">
Jul 25 15:36:39 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:36:39 user nova-compute[70869]:         </nova:port>
Jul 25 15:36:39 user nova-compute[70869]:       </nova:ports>
Jul 25 15:36:39 user nova-compute[70869]:     </nova:instance>
Jul 25 15:36:39 user nova-compute[70869]:   </metadata>
Jul 25 15:36:39 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:36:39 user nova-compute[70869]:     <system>
Jul 25 15:36:39 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:36:39 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:36:39 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:36:39 user nova-compute[70869]:       <entry name="serial">a525e472-1e7b-40b5-a4b1-5ba8bae313c9</entry>
Jul 25 15:36:39 user nova-compute[70869]:       <entry name="uuid">a525e472-1e7b-40b5-a4b1-5ba8bae313c9</entry>
Jul 25 15:36:39 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:36:39 user nova-compute[70869]:     </system>
Jul 25 15:36:39 user nova-compute[70869]:   </sysinfo>
Jul 25 15:36:39 user nova-compute[70869]:   <os>
Jul 25 15:36:39 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:36:39 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:36:39 user nova-compute[70869]:   </os>
Jul 25 15:36:39 user nova-compute[70869]:   <features>
Jul 25 15:36:39 user nova-compute[70869]:     <acpi/>
Jul 25 15:36:39 user nova-compute[70869]:     <apic/>
Jul 25 15:36:39 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:36:39 user nova-compute[70869]:   </features>
Jul 25 15:36:39 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:36:39 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:36:39 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:36:39 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:36:39 user nova-compute[70869]:   </clock>
Jul 25 15:36:39 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:36:39 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:36:39 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:36:39 user nova-compute[70869]:   </cpu>
Jul 25 15:36:39 user nova-compute[70869]:   <devices>
Jul 25 15:36:39 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:36:39 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:36:39 user nova-compute[70869]:       <source dev="/dev/sdb"/>
Jul 25 15:36:39 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:36:39 user nova-compute[70869]:       <serial>a7d4a3f2-1140-4be4-a32c-a56b6661a89e</serial>
Jul 25 15:36:39 user nova-compute[70869]:     </disk>
Jul 25 15:36:39 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:36:39 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:36:39 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.rescue"/>
Jul 25 15:36:39 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:36:39 user nova-compute[70869]:       <boot order="1"/>
Jul 25 15:36:39 user nova-compute[70869]:     </disk>
Jul 25 15:36:39 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:36:39 user nova-compute[70869]:       <mac address="fa:16:3e:4d:77:eb"/>
Jul 25 15:36:39 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:36:39 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:36:39 user nova-compute[70869]:       <target dev="tapf433efca-96"/>
Jul 25 15:36:39 user nova-compute[70869]:     </interface>
Jul 25 15:36:39 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:36:39 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/console.log" append="off"/>
Jul 25 15:36:39 user nova-compute[70869]:     </serial>
Jul 25 15:36:39 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:36:39 user nova-compute[70869]:     <video>
Jul 25 15:36:39 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:36:39 user nova-compute[70869]:     </video>
Jul 25 15:36:39 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:36:39 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:36:39 user nova-compute[70869]:     </rng>
Jul 25 15:36:39 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:36:39 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:36:39 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:36:39 user nova-compute[70869]:     </memballoon>
Jul 25 15:36:39 user nova-compute[70869]:   </devices>
Jul 25 15:36:39 user nova-compute[70869]: </domain>
Jul 25 15:36:39 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:36:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Instance destroyed successfully.
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:36:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No VIF found with MAC fa:16:3e:4d:77:eb, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:36:40 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:36:40 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-798da4f2-adeb-4e44-9f40-4b14cdf9654a req-0969638b-a047-4300-9a7b-8a5fb36a78b4 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-798da4f2-adeb-4e44-9f40-4b14cdf9654a req-0969638b-a047-4300-9a7b-8a5fb36a78b4 service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-798da4f2-adeb-4e44-9f40-4b14cdf9654a req-0969638b-a047-4300-9a7b-8a5fb36a78b4 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-798da4f2-adeb-4e44-9f40-4b14cdf9654a req-0969638b-a047-4300-9a7b-8a5fb36a78b4 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-798da4f2-adeb-4e44-9f40-4b14cdf9654a req-0969638b-a047-4300-9a7b-8a5fb36a78b4 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:36:41 user nova-compute[70869]: WARNING nova.compute.manager [req-798da4f2-adeb-4e44-9f40-4b14cdf9654a req-0969638b-a047-4300-9a7b-8a5fb36a78b4 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state active and task_state rescuing.
Jul 25 15:36:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-ca462cc8-199f-4bae-b287-fe93ed69fcd7 req-9cb9dd8e-5d01-4ec8-a8a0-124316c9be81 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ca462cc8-199f-4bae-b287-fe93ed69fcd7 req-9cb9dd8e-5d01-4ec8-a8a0-124316c9be81 service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ca462cc8-199f-4bae-b287-fe93ed69fcd7 req-9cb9dd8e-5d01-4ec8-a8a0-124316c9be81 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ca462cc8-199f-4bae-b287-fe93ed69fcd7 req-9cb9dd8e-5d01-4ec8-a8a0-124316c9be81 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-ca462cc8-199f-4bae-b287-fe93ed69fcd7 req-9cb9dd8e-5d01-4ec8-a8a0-124316c9be81 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:36:43 user nova-compute[70869]: WARNING nova.compute.manager [req-ca462cc8-199f-4bae-b287-fe93ed69fcd7 req-9cb9dd8e-5d01-4ec8-a8a0-124316c9be81 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state active and task_state rescuing.
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for a525e472-1e7b-40b5-a4b1-5ba8bae313c9 due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299403.6787412, a525e472-1e7b-40b5-a4b1-5ba8bae313c9 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:36:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] VM Resumed (Lifecycle Event)
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a6825595-6886-451e-81e4-c888f4f2bf07 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:36:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299403.6788986, a525e472-1e7b-40b5-a4b1-5ba8bae313c9 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:36:43 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] VM Started (Lifecycle Event)
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:36:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:36:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:36:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:36:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:36:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:36:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:36:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:36:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "93dbd517-8be2-4529-8146-06720336034d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "93dbd517-8be2-4529-8146-06720336034d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:37:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:04 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:37:04 user nova-compute[70869]: INFO nova.compute.claims [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Claim successful on node user
Jul 25 15:37:05 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:37:05 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:37:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:37:05 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Creating image(s)
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "/opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "/opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "/opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG nova.policy [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '522c108f563c4c18a2054332549bc66a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a813ccd5a13f4ec689ef47b069c02448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk 1073741824" returned: 0 in 0.064s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Cannot resize image /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lazy-loading 'migration_context' on Instance uuid 93dbd517-8be2-4529-8146-06720336034d {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Ensure instance console log exists: /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:06 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Successfully created port: 5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:37:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Successfully updated port: 5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:37:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "refresh_cache-93dbd517-8be2-4529-8146-06720336034d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:37:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquired lock "refresh_cache-93dbd517-8be2-4529-8146-06720336034d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:37:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:37:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:37:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-a5d7b875-2bdb-4ac1-8731-d43e1c6ecb82 req-3e6be29d-c950-46cb-8739-cfc9762c3dcb service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received event network-changed-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-a5d7b875-2bdb-4ac1-8731-d43e1c6ecb82 req-3e6be29d-c950-46cb-8739-cfc9762c3dcb service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Refreshing instance network info cache due to event network-changed-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:37:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a5d7b875-2bdb-4ac1-8731-d43e1c6ecb82 req-3e6be29d-c950-46cb-8739-cfc9762c3dcb service nova] Acquiring lock "refresh_cache-93dbd517-8be2-4529-8146-06720336034d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Updating instance_info_cache with network_info: [{"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Releasing lock "refresh_cache-93dbd517-8be2-4529-8146-06720336034d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Instance network_info: |[{"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a5d7b875-2bdb-4ac1-8731-d43e1c6ecb82 req-3e6be29d-c950-46cb-8739-cfc9762c3dcb service nova] Acquired lock "refresh_cache-93dbd517-8be2-4529-8146-06720336034d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-a5d7b875-2bdb-4ac1-8731-d43e1c6ecb82 req-3e6be29d-c950-46cb-8739-cfc9762c3dcb service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Refreshing network info cache for port 5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Start _get_guest_xml network_info=[{"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:37:08 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:37:08 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1754513723',display_name='tempest-VolumesActionsTest-instance-1754513723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1754513723',id=18,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813ccd5a13f4ec689ef47b069c02448',ramdisk_id='',reservation_id='r-v64uqlqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1245951475',owner_user_name='tempest-VolumesActionsTest-1245951475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:37:06Z,user_data=None,user_id='522c108f563c4c18a2054332549bc66a',uuid=93dbd517-8be2-4529-8146-06720336034d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converting VIF {"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b0a9e-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lazy-loading 'pci_devices' on Instance uuid 93dbd517-8be2-4529-8146-06720336034d {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:37:08 user nova-compute[70869]:   <uuid>93dbd517-8be2-4529-8146-06720336034d</uuid>
Jul 25 15:37:08 user nova-compute[70869]:   <name>instance-00000012</name>
Jul 25 15:37:08 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:37:08 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:37:08 user nova-compute[70869]:   <metadata>
Jul 25 15:37:08 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:37:08 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:37:08 user nova-compute[70869]:       <nova:name>tempest-VolumesActionsTest-instance-1754513723</nova:name>
Jul 25 15:37:08 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:37:08</nova:creationTime>
Jul 25 15:37:08 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:37:08 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:37:08 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:37:08 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:37:08 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:37:08 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:37:08 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:37:08 user nova-compute[70869]:       <nova:owner>
Jul 25 15:37:08 user nova-compute[70869]:         <nova:user uuid="522c108f563c4c18a2054332549bc66a">tempest-VolumesActionsTest-1245951475-project-member</nova:user>
Jul 25 15:37:08 user nova-compute[70869]:         <nova:project uuid="a813ccd5a13f4ec689ef47b069c02448">tempest-VolumesActionsTest-1245951475</nova:project>
Jul 25 15:37:08 user nova-compute[70869]:       </nova:owner>
Jul 25 15:37:08 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:37:08 user nova-compute[70869]:       <nova:ports>
Jul 25 15:37:08 user nova-compute[70869]:         <nova:port uuid="5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6">
Jul 25 15:37:08 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 15:37:08 user nova-compute[70869]:         </nova:port>
Jul 25 15:37:08 user nova-compute[70869]:       </nova:ports>
Jul 25 15:37:08 user nova-compute[70869]:     </nova:instance>
Jul 25 15:37:08 user nova-compute[70869]:   </metadata>
Jul 25 15:37:08 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:37:08 user nova-compute[70869]:     <system>
Jul 25 15:37:08 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:37:08 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:37:08 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:37:08 user nova-compute[70869]:       <entry name="serial">93dbd517-8be2-4529-8146-06720336034d</entry>
Jul 25 15:37:08 user nova-compute[70869]:       <entry name="uuid">93dbd517-8be2-4529-8146-06720336034d</entry>
Jul 25 15:37:08 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:37:08 user nova-compute[70869]:     </system>
Jul 25 15:37:08 user nova-compute[70869]:   </sysinfo>
Jul 25 15:37:08 user nova-compute[70869]:   <os>
Jul 25 15:37:08 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:37:08 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:37:08 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:37:08 user nova-compute[70869]:   </os>
Jul 25 15:37:08 user nova-compute[70869]:   <features>
Jul 25 15:37:08 user nova-compute[70869]:     <acpi/>
Jul 25 15:37:08 user nova-compute[70869]:     <apic/>
Jul 25 15:37:08 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:37:08 user nova-compute[70869]:   </features>
Jul 25 15:37:08 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:37:08 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:37:08 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:37:08 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:37:08 user nova-compute[70869]:   </clock>
Jul 25 15:37:08 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:37:08 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:37:08 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:37:08 user nova-compute[70869]:   </cpu>
Jul 25 15:37:08 user nova-compute[70869]:   <devices>
Jul 25 15:37:08 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:37:08 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:37:08 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk"/>
Jul 25 15:37:08 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:37:08 user nova-compute[70869]:     </disk>
Jul 25 15:37:08 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:37:08 user nova-compute[70869]:       <mac address="fa:16:3e:eb:67:b9"/>
Jul 25 15:37:08 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:37:08 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:37:08 user nova-compute[70869]:       <target dev="tap5d3b0a9e-6f"/>
Jul 25 15:37:08 user nova-compute[70869]:     </interface>
Jul 25 15:37:08 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:37:08 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/console.log" append="off"/>
Jul 25 15:37:08 user nova-compute[70869]:     </serial>
Jul 25 15:37:08 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:37:08 user nova-compute[70869]:     <video>
Jul 25 15:37:08 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:37:08 user nova-compute[70869]:     </video>
Jul 25 15:37:08 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:37:08 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:37:08 user nova-compute[70869]:     </rng>
Jul 25 15:37:08 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:37:08 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:37:08 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:37:08 user nova-compute[70869]:     </memballoon>
Jul 25 15:37:08 user nova-compute[70869]:   </devices>
Jul 25 15:37:08 user nova-compute[70869]: </domain>
Jul 25 15:37:08 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1754513723',display_name='tempest-VolumesActionsTest-instance-1754513723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1754513723',id=18,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813ccd5a13f4ec689ef47b069c02448',ramdisk_id='',reservation_id='r-v64uqlqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1245951475',owner_user_name='tempest-VolumesActionsTest-1245951475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:37:06Z,user_data=None,user_id='522c108f563c4c18a2054332549bc66a',uuid=93dbd517-8be2-4529-8146-06720336034d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converting VIF {"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b0a9e-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG os_vif [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b0a9e-6f') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d3b0a9e-6f, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d3b0a9e-6f, col_values=(('external_ids', {'iface-id': '5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:67:b9', 'vm-uuid': '93dbd517-8be2-4529-8146-06720336034d'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:08 user nova-compute[70869]: INFO os_vif [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b0a9e-6f')
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] No VIF found with MAC fa:16:3e:eb:67:b9, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-a5d7b875-2bdb-4ac1-8731-d43e1c6ecb82 req-3e6be29d-c950-46cb-8739-cfc9762c3dcb service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Updated VIF entry in instance network info cache for port 5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-a5d7b875-2bdb-4ac1-8731-d43e1c6ecb82 req-3e6be29d-c950-46cb-8739-cfc9762c3dcb service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Updating instance_info_cache with network_info: [{"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a5d7b875-2bdb-4ac1-8731-d43e1c6ecb82 req-3e6be29d-c950-46cb-8739-cfc9762c3dcb service nova] Releasing lock "refresh_cache-93dbd517-8be2-4529-8146-06720336034d" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:37:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-055357dd-3d51-4982-9bcc-e769f75412b9 req-eee41ad7-9006-402c-b3ef-9ad5f1b9dbd7 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received event network-vif-plugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-055357dd-3d51-4982-9bcc-e769f75412b9 req-eee41ad7-9006-402c-b3ef-9ad5f1b9dbd7 service nova] Acquiring lock "93dbd517-8be2-4529-8146-06720336034d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-055357dd-3d51-4982-9bcc-e769f75412b9 req-eee41ad7-9006-402c-b3ef-9ad5f1b9dbd7 service nova] Lock "93dbd517-8be2-4529-8146-06720336034d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-055357dd-3d51-4982-9bcc-e769f75412b9 req-eee41ad7-9006-402c-b3ef-9ad5f1b9dbd7 service nova] Lock "93dbd517-8be2-4529-8146-06720336034d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-055357dd-3d51-4982-9bcc-e769f75412b9 req-eee41ad7-9006-402c-b3ef-9ad5f1b9dbd7 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] No waiting events found dispatching network-vif-plugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:10 user nova-compute[70869]: WARNING nova.compute.manager [req-055357dd-3d51-4982-9bcc-e769f75412b9 req-eee41ad7-9006-402c-b3ef-9ad5f1b9dbd7 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received unexpected event network-vif-plugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 for instance with vm_state building and task_state spawning.
Jul 25 15:37:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299432.3633943, 93dbd517-8be2-4529-8146-06720336034d => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:37:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 93dbd517-8be2-4529-8146-06720336034d] VM Resumed (Lifecycle Event)
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:37:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 93dbd517-8be2-4529-8146-06720336034d] Instance spawned successfully.
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 93dbd517-8be2-4529-8146-06720336034d] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 93dbd517-8be2-4529-8146-06720336034d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-e63416b9-c72e-4217-ab8b-3afd3e2e3d34 req-cfa3ac84-22b8-4301-81cf-8d5ffd09c176 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received event network-vif-plugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e63416b9-c72e-4217-ab8b-3afd3e2e3d34 req-cfa3ac84-22b8-4301-81cf-8d5ffd09c176 service nova] Acquiring lock "93dbd517-8be2-4529-8146-06720336034d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e63416b9-c72e-4217-ab8b-3afd3e2e3d34 req-cfa3ac84-22b8-4301-81cf-8d5ffd09c176 service nova] Lock "93dbd517-8be2-4529-8146-06720336034d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e63416b9-c72e-4217-ab8b-3afd3e2e3d34 req-cfa3ac84-22b8-4301-81cf-8d5ffd09c176 service nova] Lock "93dbd517-8be2-4529-8146-06720336034d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-e63416b9-c72e-4217-ab8b-3afd3e2e3d34 req-cfa3ac84-22b8-4301-81cf-8d5ffd09c176 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] No waiting events found dispatching network-vif-plugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:12 user nova-compute[70869]: WARNING nova.compute.manager [req-e63416b9-c72e-4217-ab8b-3afd3e2e3d34 req-cfa3ac84-22b8-4301-81cf-8d5ffd09c176 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received unexpected event network-vif-plugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 for instance with vm_state building and task_state spawning.
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 93dbd517-8be2-4529-8146-06720336034d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299432.3669982, 93dbd517-8be2-4529-8146-06720336034d => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:37:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 93dbd517-8be2-4529-8146-06720336034d] VM Started (Lifecycle Event)
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 93dbd517-8be2-4529-8146-06720336034d] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 93dbd517-8be2-4529-8146-06720336034d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:37:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 93dbd517-8be2-4529-8146-06720336034d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:37:12 user nova-compute[70869]: INFO nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Took 6.83 seconds to spawn the instance on the hypervisor.
Jul 25 15:37:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:12 user nova-compute[70869]: INFO nova.compute.manager [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Took 7.80 seconds to build instance.
Jul 25 15:37:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4548b413-e141-4340-993e-b42dcee9a07b tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "93dbd517-8be2-4529-8146-06720336034d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.903s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:14 user nova-compute[70869]: INFO nova.compute.manager [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Terminating instance
Jul 25 15:37:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-9a77e3d8-57d3-44cf-a2d6-2c50f4ecd481 req-9d5ce997-270c-4a8a-b5d1-c646fb6dabaf service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received event network-vif-unplugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9a77e3d8-57d3-44cf-a2d6-2c50f4ecd481 req-9d5ce997-270c-4a8a-b5d1-c646fb6dabaf service nova] Acquiring lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9a77e3d8-57d3-44cf-a2d6-2c50f4ecd481 req-9d5ce997-270c-4a8a-b5d1-c646fb6dabaf service nova] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9a77e3d8-57d3-44cf-a2d6-2c50f4ecd481 req-9d5ce997-270c-4a8a-b5d1-c646fb6dabaf service nova] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-9a77e3d8-57d3-44cf-a2d6-2c50f4ecd481 req-9d5ce997-270c-4a8a-b5d1-c646fb6dabaf service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] No waiting events found dispatching network-vif-unplugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-9a77e3d8-57d3-44cf-a2d6-2c50f4ecd481 req-9d5ce997-270c-4a8a-b5d1-c646fb6dabaf service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received event network-vif-unplugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:37:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Instance destroyed successfully.
Jul 25 15:37:15 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lazy-loading 'resources' on Instance uuid 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1818466798',display_name='tempest-VolumesAdminNegativeTest-server-1818466798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1818466798',id=16,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:35:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9df48376ed604fc09522486062251014',ramdisk_id='',reservation_id='r-zqj66cd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-45810269',owner_user_name='tempest-VolumesAdminNegativeTest-45810269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:35:18Z,user_data=None,user_id='56ffae89ce9840258e11b4866a315821',uuid=7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converting VIF {"id": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "address": "fa:16:3e:06:fa:7d", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c9482-92", "ovs_interfaceid": "259c9482-9299-49f0-9e0c-6e1d3e65a5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:fa:7d,bridge_name='br-int',has_traffic_filtering=True,id=259c9482-9299-49f0-9e0c-6e1d3e65a5c5,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c9482-92') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG os_vif [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:fa:7d,bridge_name='br-int',has_traffic_filtering=True,id=259c9482-9299-49f0-9e0c-6e1d3e65a5c5,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c9482-92') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap259c9482-92, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:37:15 user nova-compute[70869]: INFO os_vif [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:fa:7d,bridge_name='br-int',has_traffic_filtering=True,id=259c9482-9299-49f0-9e0c-6e1d3e65a5c5,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c9482-92')
Jul 25 15:37:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Deleting instance files /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f_del
Jul 25 15:37:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Deletion of /opt/stack/data/nova/instances/7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f_del complete
Jul 25 15:37:15 user nova-compute[70869]: INFO nova.compute.manager [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 25 15:37:15 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:15 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Took 0.62 seconds to deallocate network for instance.
Jul 25 15:37:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:16 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:37:16 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:37:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:16 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Deleted allocations for instance 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f
Jul 25 15:37:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b3ee0672-2834-4241-aa5d-6470743b4f7b tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-8974837b-4a07-4072-ae0c-b4096c9519b2 req-822d169f-249e-4fea-bbc8-9641cbf0695c service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received event network-vif-plugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8974837b-4a07-4072-ae0c-b4096c9519b2 req-822d169f-249e-4fea-bbc8-9641cbf0695c service nova] Acquiring lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8974837b-4a07-4072-ae0c-b4096c9519b2 req-822d169f-249e-4fea-bbc8-9641cbf0695c service nova] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8974837b-4a07-4072-ae0c-b4096c9519b2 req-822d169f-249e-4fea-bbc8-9641cbf0695c service nova] Lock "7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-8974837b-4a07-4072-ae0c-b4096c9519b2 req-822d169f-249e-4fea-bbc8-9641cbf0695c service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] No waiting events found dispatching network-vif-plugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:16 user nova-compute[70869]: WARNING nova.compute.manager [req-8974837b-4a07-4072-ae0c-b4096c9519b2 req-822d169f-249e-4fea-bbc8-9641cbf0695c service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received unexpected event network-vif-plugged-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 for instance with vm_state deleted and task_state None.
Jul 25 15:37:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-8974837b-4a07-4072-ae0c-b4096c9519b2 req-822d169f-249e-4fea-bbc8-9641cbf0695c service nova] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Received event network-vif-deleted-259c9482-9299-49f0-9e0c-6e1d3e65a5c5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:37:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:17 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:37:17 user nova-compute[70869]: INFO nova.compute.claims [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Claim successful on node user
Jul 25 15:37:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG nova.network.neutron [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:37:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:37:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG nova.policy [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5363af86370d49bd8082de16ae83a936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a893391d45fd4eafa016e42722702ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:37:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Creating image(s)
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "/opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "/opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "/opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.156s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:18 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk 1073741824" returned: 0 in 0.058s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.194s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Cannot resize image /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG nova.objects.instance [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'migration_context' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Ensure instance console log exists: /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:19 user nova-compute[70869]: DEBUG nova.network.neutron [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Successfully created port: eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:37:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Successfully updated port: eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:37:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:37:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquired lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:37:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:37:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-edb96e2e-d389-413c-9219-5b3fff1e5b9e req-30972291-32ba-4fc2-b24c-905405303550 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-changed-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-edb96e2e-d389-413c-9219-5b3fff1e5b9e req-30972291-32ba-4fc2-b24c-905405303550 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Refreshing instance network info cache due to event network-changed-eebac77a-9411-485f-b850-c2798d0b4b24. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:37:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-edb96e2e-d389-413c-9219-5b3fff1e5b9e req-30972291-32ba-4fc2-b24c-905405303550 service nova] Acquiring lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:37:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance_info_cache with network_info: [{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Releasing lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance network_info: |[{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-edb96e2e-d389-413c-9219-5b3fff1e5b9e req-30972291-32ba-4fc2-b24c-905405303550 service nova] Acquired lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-edb96e2e-d389-413c-9219-5b3fff1e5b9e req-30972291-32ba-4fc2-b24c-905405303550 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Refreshing network info cache for port eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Start _get_guest_xml network_info=[{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:37:21 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:37:21 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-244416485',display_name='tempest-ServerActionsTestOtherB-server-244416485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-244416485',id=19,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCXboWq8wEzceGCnyi332NqxevvINDJCRjntKF4hIJqpSF49+vs1jbRHF6AATQTYe8No7x4pmRlaWfwGgtbv6ak2EUh6sjCd7bivOrD55NzuNL4hDOGe4J6h+BwET+hSw==',key_name='tempest-keypair-273420356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a893391d45fd4eafa016e42722702ac2',ramdisk_id='',reservation_id='r-mt2igj69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1757328199',owner_user_name='tempest-ServerActionsTestOtherB-1757328199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5363af86370d49bd8082de16ae83a936',uuid=d384e3b6-8948-4db0-8d39-a340cb130c57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converting VIF {"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.objects.instance [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'pci_devices' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:37:21 user nova-compute[70869]:   <uuid>d384e3b6-8948-4db0-8d39-a340cb130c57</uuid>
Jul 25 15:37:21 user nova-compute[70869]:   <name>instance-00000013</name>
Jul 25 15:37:21 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:37:21 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:37:21 user nova-compute[70869]:   <metadata>
Jul 25 15:37:21 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:37:21 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:37:21 user nova-compute[70869]:       <nova:name>tempest-ServerActionsTestOtherB-server-244416485</nova:name>
Jul 25 15:37:21 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:37:21</nova:creationTime>
Jul 25 15:37:21 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:37:21 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:37:21 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:37:21 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:37:21 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:37:21 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:37:21 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:37:21 user nova-compute[70869]:       <nova:owner>
Jul 25 15:37:21 user nova-compute[70869]:         <nova:user uuid="5363af86370d49bd8082de16ae83a936">tempest-ServerActionsTestOtherB-1757328199-project-member</nova:user>
Jul 25 15:37:21 user nova-compute[70869]:         <nova:project uuid="a893391d45fd4eafa016e42722702ac2">tempest-ServerActionsTestOtherB-1757328199</nova:project>
Jul 25 15:37:21 user nova-compute[70869]:       </nova:owner>
Jul 25 15:37:21 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:37:21 user nova-compute[70869]:       <nova:ports>
Jul 25 15:37:21 user nova-compute[70869]:         <nova:port uuid="eebac77a-9411-485f-b850-c2798d0b4b24">
Jul 25 15:37:21 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 15:37:21 user nova-compute[70869]:         </nova:port>
Jul 25 15:37:21 user nova-compute[70869]:       </nova:ports>
Jul 25 15:37:21 user nova-compute[70869]:     </nova:instance>
Jul 25 15:37:21 user nova-compute[70869]:   </metadata>
Jul 25 15:37:21 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:37:21 user nova-compute[70869]:     <system>
Jul 25 15:37:21 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:37:21 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:37:21 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:37:21 user nova-compute[70869]:       <entry name="serial">d384e3b6-8948-4db0-8d39-a340cb130c57</entry>
Jul 25 15:37:21 user nova-compute[70869]:       <entry name="uuid">d384e3b6-8948-4db0-8d39-a340cb130c57</entry>
Jul 25 15:37:21 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:37:21 user nova-compute[70869]:     </system>
Jul 25 15:37:21 user nova-compute[70869]:   </sysinfo>
Jul 25 15:37:21 user nova-compute[70869]:   <os>
Jul 25 15:37:21 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:37:21 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:37:21 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:37:21 user nova-compute[70869]:   </os>
Jul 25 15:37:21 user nova-compute[70869]:   <features>
Jul 25 15:37:21 user nova-compute[70869]:     <acpi/>
Jul 25 15:37:21 user nova-compute[70869]:     <apic/>
Jul 25 15:37:21 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:37:21 user nova-compute[70869]:   </features>
Jul 25 15:37:21 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:37:21 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:37:21 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:37:21 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:37:21 user nova-compute[70869]:   </clock>
Jul 25 15:37:21 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:37:21 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:37:21 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:37:21 user nova-compute[70869]:   </cpu>
Jul 25 15:37:21 user nova-compute[70869]:   <devices>
Jul 25 15:37:21 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:37:21 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:37:21 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk"/>
Jul 25 15:37:21 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:37:21 user nova-compute[70869]:     </disk>
Jul 25 15:37:21 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:37:21 user nova-compute[70869]:       <mac address="fa:16:3e:e3:a3:59"/>
Jul 25 15:37:21 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:37:21 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:37:21 user nova-compute[70869]:       <target dev="tapeebac77a-94"/>
Jul 25 15:37:21 user nova-compute[70869]:     </interface>
Jul 25 15:37:21 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:37:21 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/console.log" append="off"/>
Jul 25 15:37:21 user nova-compute[70869]:     </serial>
Jul 25 15:37:21 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:37:21 user nova-compute[70869]:     <video>
Jul 25 15:37:21 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:37:21 user nova-compute[70869]:     </video>
Jul 25 15:37:21 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:37:21 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:37:21 user nova-compute[70869]:     </rng>
Jul 25 15:37:21 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:37:21 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:37:21 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:37:21 user nova-compute[70869]:     </memballoon>
Jul 25 15:37:21 user nova-compute[70869]:   </devices>
Jul 25 15:37:21 user nova-compute[70869]: </domain>
Jul 25 15:37:21 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-244416485',display_name='tempest-ServerActionsTestOtherB-server-244416485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-244416485',id=19,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCXboWq8wEzceGCnyi332NqxevvINDJCRjntKF4hIJqpSF49+vs1jbRHF6AATQTYe8No7x4pmRlaWfwGgtbv6ak2EUh6sjCd7bivOrD55NzuNL4hDOGe4J6h+BwET+hSw==',key_name='tempest-keypair-273420356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a893391d45fd4eafa016e42722702ac2',ramdisk_id='',reservation_id='r-mt2igj69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1757328199',owner_user_name='tempest-ServerActionsTestOtherB-1757328199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5363af86370d49bd8082de16ae83a936',uuid=d384e3b6-8948-4db0-8d39-a340cb130c57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converting VIF {"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG os_vif [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeebac77a-94, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeebac77a-94, col_values=(('external_ids', {'iface-id': 'eebac77a-9411-485f-b850-c2798d0b4b24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:a3:59', 'vm-uuid': 'd384e3b6-8948-4db0-8d39-a340cb130c57'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:21 user nova-compute[70869]: INFO os_vif [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94')
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] No VIF found with MAC fa:16:3e:e3:a3:59, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-edb96e2e-d389-413c-9219-5b3fff1e5b9e req-30972291-32ba-4fc2-b24c-905405303550 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updated VIF entry in instance network info cache for port eebac77a-9411-485f-b850-c2798d0b4b24. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-edb96e2e-d389-413c-9219-5b3fff1e5b9e req-30972291-32ba-4fc2-b24c-905405303550 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance_info_cache with network_info: [{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-edb96e2e-d389-413c-9219-5b3fff1e5b9e req-30972291-32ba-4fc2-b24c-905405303550 service nova] Releasing lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:37:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-7bd4032d-6f5f-4fef-91f6-fda6fd753e27 req-406da9d6-80ba-4067-ba40-e2ad2e1d93ec service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7bd4032d-6f5f-4fef-91f6-fda6fd753e27 req-406da9d6-80ba-4067-ba40-e2ad2e1d93ec service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7bd4032d-6f5f-4fef-91f6-fda6fd753e27 req-406da9d6-80ba-4067-ba40-e2ad2e1d93ec service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7bd4032d-6f5f-4fef-91f6-fda6fd753e27 req-406da9d6-80ba-4067-ba40-e2ad2e1d93ec service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-7bd4032d-6f5f-4fef-91f6-fda6fd753e27 req-406da9d6-80ba-4067-ba40-e2ad2e1d93ec service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:23 user nova-compute[70869]: WARNING nova.compute.manager [req-7bd4032d-6f5f-4fef-91f6-fda6fd753e27 req-406da9d6-80ba-4067-ba40-e2ad2e1d93ec service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state building and task_state spawning.
Jul 25 15:37:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-af9add76-71e0-4ba9-b065-a28ab1e4a614 req-a9b30a31-7b3d-455b-b837-7e8d0a951b10 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-af9add76-71e0-4ba9-b065-a28ab1e4a614 req-a9b30a31-7b3d-455b-b837-7e8d0a951b10 service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-af9add76-71e0-4ba9-b065-a28ab1e4a614 req-a9b30a31-7b3d-455b-b837-7e8d0a951b10 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-af9add76-71e0-4ba9-b065-a28ab1e4a614 req-a9b30a31-7b3d-455b-b837-7e8d0a951b10 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-af9add76-71e0-4ba9-b065-a28ab1e4a614 req-a9b30a31-7b3d-455b-b837-7e8d0a951b10 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:25 user nova-compute[70869]: WARNING nova.compute.manager [req-af9add76-71e0-4ba9-b065-a28ab1e4a614 req-a9b30a31-7b3d-455b-b837-7e8d0a951b10 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state building and task_state spawning.
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299445.6707559, d384e3b6-8948-4db0-8d39-a340cb130c57 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:37:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] VM Resumed (Lifecycle Event)
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:37:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance spawned successfully.
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:37:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299445.6723566, d384e3b6-8948-4db0-8d39-a340cb130c57 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:37:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] VM Started (Lifecycle Event)
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances with incomplete migration  {{(pid=70869) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:37:25 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:37:25 user nova-compute[70869]: INFO nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Took 7.22 seconds to spawn the instance on the hypervisor.
Jul 25 15:37:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:25 user nova-compute[70869]: INFO nova.compute.manager [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Took 8.17 seconds to build instance.
Jul 25 15:37:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-631d1e5e-db18-4a90-af4d-387c45c406c9 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.289s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:28 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:28 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:37:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:37:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:37:28 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:37:29 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Updating instance_info_cache with network_info: [{"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:37:29 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:37:29 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:29 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 15:37:29 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] There are 0 instances to clean {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 15:37:30 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299435.1094825, 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:37:30 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] VM Stopped (Lifecycle Event)
Jul 25 15:37:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-31bbe42d-2a88-423f-ba55-32b814f0721c None None] [instance: 7cbc7ba6-8d1f-46ed-895c-bdc52af5ac8f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:30 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:31 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:37:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:37:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:37:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:37 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:37:37 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7127MB free_disk=25.496490478515625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fa170559-5228-448f-acea-c5b816a22631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 08fa2836-717a-4893-8969-fcab677935a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 3b38a39b-5ad8-4341-b132-597b8ab6a849 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 93dbd517-8be2-4529-8146-06720336034d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d384e3b6-8948-4db0-8d39-a340cb130c57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:37:37 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing inventories for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating ProviderTree inventory for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing aggregate associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, aggregates: None {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing trait associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41 {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:38 user nova-compute[70869]: INFO nova.compute.manager [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Terminating instance
Jul 25 15:37:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:37:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.599s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-b36de092-dac7-4006-8423-671b9fed190c req-8768f2c3-ef54-4361-bd04-7f6dded9b8cf service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-unplugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b36de092-dac7-4006-8423-671b9fed190c req-8768f2c3-ef54-4361-bd04-7f6dded9b8cf service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b36de092-dac7-4006-8423-671b9fed190c req-8768f2c3-ef54-4361-bd04-7f6dded9b8cf service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b36de092-dac7-4006-8423-671b9fed190c req-8768f2c3-ef54-4361-bd04-7f6dded9b8cf service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-b36de092-dac7-4006-8423-671b9fed190c req-8768f2c3-ef54-4361-bd04-7f6dded9b8cf service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No waiting events found dispatching network-vif-unplugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-b36de092-dac7-4006-8423-671b9fed190c req-8768f2c3-ef54-4361-bd04-7f6dded9b8cf service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-unplugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Instance destroyed successfully.
Jul 25 15:37:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'resources' on Instance uuid 3b38a39b-5ad8-4341-b132-597b8ab6a849 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-779221569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-805847803',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIkVAmxmlz9/k5ZXxC76vtVdp+U7q5KzaQBmndoNBkWoKxXxqljSS1jb5uYAjGuvcLIZ8lDA73m2VNNzORpITL5U/MKWIHqpe2k7cYW8WX1atjyqJ4EsYC2Jah+XtUpLw==',key_name='tempest-keypair-1784292135',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27d4e6ad84894e2d8ca5aee1aa77db4e',ramdisk_id='',reservation_id='r-0fnuttbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1601506810',owner_user_name='tempest-ServerActionsV293TestJSON-1601506810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:36:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0d6af7f176145f382a7cc839ed2c027',uuid=3b38a39b-5ad8-4341-b132-597b8ab6a849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converting VIF {"id": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "address": "fa:16:3e:08:25:0f", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bde5f26-2d", "ovs_interfaceid": "7bde5f26-2d7a-4e3e-adff-311873ad7a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_vif [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bde5f26-2d, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:37:39 user nova-compute[70869]: INFO os_vif [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:25:0f,bridge_name='br-int',has_traffic_filtering=True,id=7bde5f26-2d7a-4e3e-adff-311873ad7a87,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bde5f26-2d')
Jul 25 15:37:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awASrUZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:37:39 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e67142-858f-4572-9ea1-d71412faac05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:37:39 user nova-compute[70869]: No targets found.
Jul 25 15:37:39 user nova-compute[70869]: iSNS:
Jul 25 15:37:39 user nova-compute[70869]: No targets found.
Jul 25 15:37:39 user nova-compute[70869]: STATIC:
Jul 25 15:37:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283
Jul 25 15:37:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:37:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:37:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d
Jul 25 15:37:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:37:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:37:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203
Jul 25 15:37:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:37:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:37:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:37:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:37:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:37:39 user nova-compute[70869]: FIRMWARE:
Jul 25 15:37:39 user nova-compute[70869]: No targets found.
Jul 25 15:37:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:37:39 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:37:39 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[de717c58-2ed0-42e5-8359-a43c2acb6ed1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[df24ca61-3e16-45b2-a23f-c3edfc33ffec]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:37:39 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:37:39 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:37:39 user nova-compute[70869]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:37:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:37:39 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:37:39 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:37:39 user nova-compute[70869]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 (non-flash)
Jul 25 15:37:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c23d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9589e6-007c-462a-a562-96a56fb83fd1]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dff482-991d-4aae-8f00-d025821ee14f]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae96b17e-a5a8-4f4e-9269-06f6922ccc1a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c963ef-43f9-42a1-a6c4-b0f0a8b1f6a8]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc04c71d4-ad7b47292a293ae9', '/dev/disk/by-id/scsi-26164376234373239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c04c71d4') {{(pid=82054) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e4e982-34ed-4455-bea2-09bf1d59862b]: (4, None) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6b9221-5ccf-46e3-ae48-07bd74eeca4a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[472fceef-a5e1-4e09-9bcb-84a44d884ad5]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260]
Jul 25 15:37:39 user nova-compute[70869]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283, portal: 172.16.0.220,3260] successful.
Jul 25 15:37:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fab0f90-3418-4b93-b8dd-d2bd164db283 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b980b-5bc4-4601-b424-426065317af3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] <== disconnect_volume: return (414ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:37:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:37:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Deleting instance files /opt/stack/data/nova/instances/3b38a39b-5ad8-4341-b132-597b8ab6a849_del
Jul 25 15:37:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Deletion of /opt/stack/data/nova/instances/3b38a39b-5ad8-4341-b132-597b8ab6a849_del complete
Jul 25 15:37:39 user nova-compute[70869]: INFO nova.compute.manager [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Took 1.44 seconds to destroy the instance on the hypervisor.
Jul 25 15:37:39 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:37:40 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:37:40 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:37:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:41 user nova-compute[70869]: INFO nova.compute.manager [None req-e6752d97-10a0-48c5-ab94-38fd9772670e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Unrescuing
Jul 25 15:37:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e6752d97-10a0-48c5-ab94-38fd9772670e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:37:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e6752d97-10a0-48c5-ab94-38fd9772670e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquired lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:37:41 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e6752d97-10a0-48c5-ab94-38fd9772670e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:37:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-ed016c44-792d-42cd-a345-261e5cc8efd2 req-9b2c75ea-069e-42ef-b381-31574f6d6f59 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ed016c44-792d-42cd-a345-261e5cc8efd2 req-9b2c75ea-069e-42ef-b381-31574f6d6f59 service nova] Acquiring lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ed016c44-792d-42cd-a345-261e5cc8efd2 req-9b2c75ea-069e-42ef-b381-31574f6d6f59 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ed016c44-792d-42cd-a345-261e5cc8efd2 req-9b2c75ea-069e-42ef-b381-31574f6d6f59 service nova] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-ed016c44-792d-42cd-a345-261e5cc8efd2 req-9b2c75ea-069e-42ef-b381-31574f6d6f59 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] No waiting events found dispatching network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:41 user nova-compute[70869]: WARNING nova.compute.manager [req-ed016c44-792d-42cd-a345-261e5cc8efd2 req-9b2c75ea-069e-42ef-b381-31574f6d6f59 service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received unexpected event network-vif-plugged-7bde5f26-2d7a-4e3e-adff-311873ad7a87 for instance with vm_state active and task_state deleting.
Jul 25 15:37:41 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:41 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Took 1.39 seconds to deallocate network for instance.
Jul 25 15:37:43 user nova-compute[70869]: INFO nova.compute.manager [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Took 1.07 seconds to detach 1 volumes for instance.
Jul 25 15:37:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Deleting volume: 1fab0f90-3418-4b93-b8dd-d2bd164db283 {{(pid=70869) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e6752d97-10a0-48c5-ab94-38fd9772670e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating instance_info_cache with network_info: [{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e6752d97-10a0-48c5-ab94-38fd9772670e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Releasing lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e6752d97-10a0-48c5-ab94-38fd9772670e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'flavor' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-3fb5f516-0828-404b-b60b-e126404cda92 req-31721ef3-5f67-4d79-a0c0-d15eb6f8fdf4 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-changed-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-3fb5f516-0828-404b-b60b-e126404cda92 req-31721ef3-5f67-4d79-a0c0-d15eb6f8fdf4 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Refreshing instance network info cache due to event network-changed-b512c720-cc12-4cbd-98b1-62b64bc2a752. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3fb5f516-0828-404b-b60b-e126404cda92 req-31721ef3-5f67-4d79-a0c0-d15eb6f8fdf4 service nova] Acquiring lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3fb5f516-0828-404b-b60b-e126404cda92 req-31721ef3-5f67-4d79-a0c0-d15eb6f8fdf4 service nova] Acquired lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-3fb5f516-0828-404b-b60b-e126404cda92 req-31721ef3-5f67-4d79-a0c0-d15eb6f8fdf4 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Refreshing network info cache for port b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-5565b416-af54-4d8a-a31a-1ac89657494b req-8ba0bf44-4a04-4cb9-b378-2a5f43fa3c6b service nova] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Received event network-vif-deleted-7bde5f26-2d7a-4e3e-adff-311873ad7a87 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:37:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:43 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Deleted allocations for instance 3b38a39b-5ad8-4341-b132-597b8ab6a849
Jul 25 15:37:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2534e8d-b0a5-4d7b-8600-cfd4c9c90805 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "3b38a39b-5ad8-4341-b132-597b8ab6a849" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.081s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fa170559-5228-448f-acea-c5b816a22631] Instance destroyed successfully.
Jul 25 15:37:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-071e4899-7624-4419-9b92-2d71c665107c req-75ac010d-4267-47cd-91ed-e8957f4d1e92 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-changed-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-071e4899-7624-4419-9b92-2d71c665107c req-75ac010d-4267-47cd-91ed-e8957f4d1e92 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Refreshing instance network info cache due to event network-changed-d545db2f-0230-400f-9bcd-e3db63ade6b6. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:37:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-071e4899-7624-4419-9b92-2d71c665107c req-75ac010d-4267-47cd-91ed-e8957f4d1e92 service nova] Acquiring lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:37:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-071e4899-7624-4419-9b92-2d71c665107c req-75ac010d-4267-47cd-91ed-e8957f4d1e92 service nova] Acquired lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:37:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-071e4899-7624-4419-9b92-2d71c665107c req-75ac010d-4267-47cd-91ed-e8957f4d1e92 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Refreshing network info cache for port d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:37:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-3fb5f516-0828-404b-b60b-e126404cda92 req-31721ef3-5f67-4d79-a0c0-d15eb6f8fdf4 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Updated VIF entry in instance network info cache for port b512c720-cc12-4cbd-98b1-62b64bc2a752. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:37:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-3fb5f516-0828-404b-b60b-e126404cda92 req-31721ef3-5f67-4d79-a0c0-d15eb6f8fdf4 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating instance_info_cache with network_info: [{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3fb5f516-0828-404b-b60b-e126404cda92 req-31721ef3-5f67-4d79-a0c0-d15eb6f8fdf4 service nova] Releasing lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:37:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-071e4899-7624-4419-9b92-2d71c665107c req-75ac010d-4267-47cd-91ed-e8957f4d1e92 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updated VIF entry in instance network info cache for port d545db2f-0230-400f-9bcd-e3db63ade6b6. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-071e4899-7624-4419-9b92-2d71c665107c req-75ac010d-4267-47cd-91ed-e8957f4d1e92 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updating instance_info_cache with network_info: [{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-832990d3-62c2-4ba0-bb43-2dc6fcc7cd78 req-fbe44589-00e6-4046-8c07-9de4b6fa8909 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-changed-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-832990d3-62c2-4ba0-bb43-2dc6fcc7cd78 req-fbe44589-00e6-4046-8c07-9de4b6fa8909 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Refreshing instance network info cache due to event network-changed-b512c720-cc12-4cbd-98b1-62b64bc2a752. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-832990d3-62c2-4ba0-bb43-2dc6fcc7cd78 req-fbe44589-00e6-4046-8c07-9de4b6fa8909 service nova] Acquiring lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-832990d3-62c2-4ba0-bb43-2dc6fcc7cd78 req-fbe44589-00e6-4046-8c07-9de4b6fa8909 service nova] Acquired lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-832990d3-62c2-4ba0-bb43-2dc6fcc7cd78 req-fbe44589-00e6-4046-8c07-9de4b6fa8909 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Refreshing network info cache for port b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-071e4899-7624-4419-9b92-2d71c665107c req-75ac010d-4267-47cd-91ed-e8957f4d1e92 service nova] Releasing lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-unplugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-unplugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:45 user nova-compute[70869]: WARNING nova.compute.manager [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-unplugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:45 user nova-compute[70869]: WARNING nova.compute.manager [req-729e3b15-a8c3-4a7c-b7e3-dac8a71cc5ad req-77139e3f-73ee-480f-9644-862bbdaa9b15 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:37:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-832990d3-62c2-4ba0-bb43-2dc6fcc7cd78 req-fbe44589-00e6-4046-8c07-9de4b6fa8909 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Updated VIF entry in instance network info cache for port b512c720-cc12-4cbd-98b1-62b64bc2a752. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-832990d3-62c2-4ba0-bb43-2dc6fcc7cd78 req-fbe44589-00e6-4046-8c07-9de4b6fa8909 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating instance_info_cache with network_info: [{"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:37:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-832990d3-62c2-4ba0-bb43-2dc6fcc7cd78 req-fbe44589-00e6-4046-8c07-9de4b6fa8909 service nova] Releasing lock "refresh_cache-fa170559-5228-448f-acea-c5b816a22631" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:37:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:47 user nova-compute[70869]: WARNING nova.compute.manager [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:47 user nova-compute[70869]: WARNING nova.compute.manager [req-334171cc-441b-40bc-9cd4-68f91582674a req-3fadf493-19b7-4433-8d63-ba184a7b3149 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for fa170559-5228-448f-acea-c5b816a22631 due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299467.6793232, fa170559-5228-448f-acea-c5b816a22631 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:37:47 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] VM Resumed (Lifecycle Event)
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e6752d97-10a0-48c5-ab94-38fd9772670e tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:37:47 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299467.6812057, fa170559-5228-448f-acea-c5b816a22631 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:37:47 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] VM Started (Lifecycle Event)
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG nova.objects.instance [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:48 user nova-compute[70869]: INFO nova.compute.manager [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Attaching volume f9fae374-9a46-4bb4-a6ea-75b14f062c16 to /dev/vdb
Jul 25 15:37:48 user nova-compute[70869]: DEBUG os_brick.utils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a32b0-a224-4dde-b584-7d4ea9d2a92f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b9c59-85ab-4673-bbf0-520e22ef53cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[712edff1-a969-42d8-b0e0-2d45245cadc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[457060ef-8233-46f1-bcae-2985278c802d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:37:48 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:37:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ca470-1092-4dba-9458-4755ace70c4b]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG os_brick.utils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updating existing volume attachment record: 07b91561-fc31-40fe-b559-978205c82bab {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:37:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_power_states {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 8beb6a74-a413-4a75-b8ce-678447cff1a5 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 5ce85315-be2f-4be3-953f-ed7b5d4685d6 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 08fa2836-717a-4893-8969-fcab677935a5 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 93dbd517-8be2-4529-8146-06720336034d {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "8beb6a74-a413-4a75-b8ce-678447cff1a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "fa170559-5228-448f-acea-c5b816a22631" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "08fa2836-717a-4893-8969-fcab677935a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "93dbd517-8be2-4529-8146-06720336034d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "93dbd517-8be2-4529-8146-06720336034d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "93dbd517-8be2-4529-8146-06720336034d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "fa170559-5228-448f-acea-c5b816a22631" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "08fa2836-717a-4893-8969-fcab677935a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:54 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299459.4325564, 3b38a39b-5ad8-4341-b132-597b8ab6a849 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:37:54 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] VM Stopped (Lifecycle Event)
Jul 25 15:37:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-21d4b38d-a0fe-4503-a826-76fdf85794db None None] [instance: 3b38a39b-5ad8-4341-b132-597b8ab6a849] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwNZofUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:37:55 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:37:55 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:37:55 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a746fde-a522-4510-8129-09d7a48c160b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:37:55 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9421e4c-3ef9-48df-bb5e-9153d2b0420f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16] added
Jul 25 15:37:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5da9667-9225-466a-a7f7-485195ad42f3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[55698a3e-85ab-4078-9bc2-61b95994d03c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwNZofUA {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwNZofUA" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0d3089-679b-41d5-a4e7-80102c2f9cff]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hwNZofUA'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e1fb27-4bb5-4848-84bd-df79f3bb25d3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e951a6-db6b-431e-a813-e20a94ff1533]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:37:55 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:37:55 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:37:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:37:55 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:37:55 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:37:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:37:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1910b15-d5a7-45ab-859f-00487d45c9f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260]
Jul 25 15:37:56 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260] successful.
Jul 25 15:37:56 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[536bda27-5dfe-45ea-8794-db590f7f1ed8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b37c3ed-8151-434b-bdb9-2363555ca2d4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:37:56 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:37:56 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:37:56 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:37:56 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:37:56 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:37:56 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:37:56 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:37:56 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[708751e0-fa1a-4d49-b51a-10f45538fcfd]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:37:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwNZofUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23164303339313832', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164303339313832', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG nova.objects.instance [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:37:57 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:37:57 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:37:57 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:37:57 user nova-compute[70869]:   <serial>f9fae374-9a46-4bb4-a6ea-75b14f062c16</serial>
Jul 25 15:37:57 user nova-compute[70869]: </disk>
Jul 25 15:37:57 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No VIF found with MAC fa:16:3e:de:f6:f9, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ff5e903-b708-41cd-82d0-b9f3c99eaeaa tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.609s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.936s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4651087f-9e09-429d-9860-c149fa0186dc tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4651087f-9e09-429d-9860-c149fa0186dc tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4651087f-9e09-429d-9860-c149fa0186dc tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4651087f-9e09-429d-9860-c149fa0186dc tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70869) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4651087f-9e09-429d-9860-c149fa0186dc tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-a9519cf5-6dba-4c5d-bcac-d29c47f18492 req-4944e0a5-aa82-45a5-9891-0de46f7e89c2 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-unplugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a9519cf5-6dba-4c5d-bcac-d29c47f18492 req-4944e0a5-aa82-45a5-9891-0de46f7e89c2 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a9519cf5-6dba-4c5d-bcac-d29c47f18492 req-4944e0a5-aa82-45a5-9891-0de46f7e89c2 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a9519cf5-6dba-4c5d-bcac-d29c47f18492 req-4944e0a5-aa82-45a5-9891-0de46f7e89c2 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-a9519cf5-6dba-4c5d-bcac-d29c47f18492 req-4944e0a5-aa82-45a5-9891-0de46f7e89c2 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-unplugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:37:58 user nova-compute[70869]: WARNING nova.compute.manager [req-a9519cf5-6dba-4c5d-bcac-d29c47f18492 req-4944e0a5-aa82-45a5-9891-0de46f7e89c2 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-unplugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state active and task_state powering-off.
Jul 25 15:37:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance destroyed successfully.
Jul 25 15:37:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4651087f-9e09-429d-9860-c149fa0186dc tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:37:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4651087f-9e09-429d-9860-c149fa0186dc tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.936s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:37:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-64da9594-7dc5-4e89-8a00-9ffc7dcdc2d3 req-e65cba49-345a-4c0f-94b7-ce2521d50aa1 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-64da9594-7dc5-4e89-8a00-9ffc7dcdc2d3 req-e65cba49-345a-4c0f-94b7-ce2521d50aa1 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-64da9594-7dc5-4e89-8a00-9ffc7dcdc2d3 req-e65cba49-345a-4c0f-94b7-ce2521d50aa1 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-64da9594-7dc5-4e89-8a00-9ffc7dcdc2d3 req-e65cba49-345a-4c0f-94b7-ce2521d50aa1 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-64da9594-7dc5-4e89-8a00-9ffc7dcdc2d3 req-e65cba49-345a-4c0f-94b7-ce2521d50aa1 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:00 user nova-compute[70869]: WARNING nova.compute.manager [req-64da9594-7dc5-4e89-8a00-9ffc7dcdc2d3 req-e65cba49-345a-4c0f-94b7-ce2521d50aa1 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state stopped and task_state None.
Jul 25 15:38:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:00 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:38:00 user nova-compute[70869]: INFO nova.compute.claims [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Claim successful on node user
Jul 25 15:38:01 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:38:01 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:38:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:38:01 user nova-compute[70869]: INFO nova.virt.block_device [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Booting with volume abd3a4fb-7d3b-4cbc-a399-8aa59081943a at /dev/vda
Jul 25 15:38:01 user nova-compute[70869]: DEBUG nova.policy [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6af1342ac93849d995a457cde23bde41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77781f71b0364014b1561b8158656565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG os_brick.utils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[26237b48-a31f-4a5c-a3cd-46638646fdae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2f39de-cafb-4e62-ba46-eca0aaf316ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[489f9953-7714-4d9a-bb18-8fa631254cc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0c5bb0-1159-42a2-a2e5-7d2b35982e2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:38:01 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:38:01 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4bd3be-586a-43aa-844f-b00aced1577d]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG os_brick.utils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:38:01 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating existing volume attachment record: 1952eddb-d5e6-4473-aa52-d79674bcbff6 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:38:02 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Successfully created port: 685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Successfully updated port: 685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquired lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-f3a5ec56-bb2d-4e73-bd7c-20d0d5df6c88 req-82fba740-8185-4d5f-8ab8-2d8685327b44 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-changed-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-f3a5ec56-bb2d-4e73-bd7c-20d0d5df6c88 req-82fba740-8185-4d5f-8ab8-2d8685327b44 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing instance network info cache due to event network-changed-685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f3a5ec56-bb2d-4e73-bd7c-20d0d5df6c88 req-82fba740-8185-4d5f-8ab8-2d8685327b44 service nova] Acquiring lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating instance_info_cache with network_info: [{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Releasing lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Instance network_info: |[{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f3a5ec56-bb2d-4e73-bd7c-20d0d5df6c88 req-82fba740-8185-4d5f-8ab8-2d8685327b44 service nova] Acquired lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:38:03 user nova-compute[70869]: DEBUG nova.network.neutron [req-f3a5ec56-bb2d-4e73-bd7c-20d0d5df6c88 req-82fba740-8185-4d5f-8ab8-2d8685327b44 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:38:04 user nova-compute[70869]: DEBUG nova.network.neutron [req-f3a5ec56-bb2d-4e73-bd7c-20d0d5df6c88 req-82fba740-8185-4d5f-8ab8-2d8685327b44 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updated VIF entry in instance network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:38:04 user nova-compute[70869]: DEBUG nova.network.neutron [req-f3a5ec56-bb2d-4e73-bd7c-20d0d5df6c88 req-82fba740-8185-4d5f-8ab8-2d8685327b44 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating instance_info_cache with network_info: [{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:38:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f3a5ec56-bb2d-4e73-bd7c-20d0d5df6c88 req-82fba740-8185-4d5f-8ab8-2d8685327b44 service nova] Releasing lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:38:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:10 user nova-compute[70869]: INFO nova.compute.manager [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Terminating instance
Jul 25 15:38:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-da811403-6eac-4d0d-ae9e-25c65f216463 req-264ffb96-c47a-4f1e-8246-86fea7630824 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-vif-unplugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-da811403-6eac-4d0d-ae9e-25c65f216463 req-264ffb96-c47a-4f1e-8246-86fea7630824 service nova] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-da811403-6eac-4d0d-ae9e-25c65f216463 req-264ffb96-c47a-4f1e-8246-86fea7630824 service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-da811403-6eac-4d0d-ae9e-25c65f216463 req-264ffb96-c47a-4f1e-8246-86fea7630824 service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-da811403-6eac-4d0d-ae9e-25c65f216463 req-264ffb96-c47a-4f1e-8246-86fea7630824 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] No waiting events found dispatching network-vif-unplugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-da811403-6eac-4d0d-ae9e-25c65f216463 req-264ffb96-c47a-4f1e-8246-86fea7630824 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-vif-unplugged-90ce04e4-d390-4067-8a50-755e4964ab52 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Instance destroyed successfully.
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lazy-loading 'resources' on Instance uuid 08fa2836-717a-4893-8969-fcab677935a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-117956932',display_name='tempest-VolumesAdminNegativeTest-server-117956932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-117956932',id=7,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaV/Pp6vgqKlD297dOFgOpV0KPmbbH6sIp9vsVy2e46eOyA+kXM1piotTyeM9QWtWUyjVTuP/xC+41/MlQWDcXy6TeFJT14MZao2as99pIGBc4Jmbtnnz4rv5VHJBVusw==',key_name='tempest-keypair-928566050',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9df48376ed604fc09522486062251014',ramdisk_id='',reservation_id='r-ww4u8wn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-45810269',owner_user_name='tempest-VolumesAdminNegativeTest-45810269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56ffae89ce9840258e11b4866a315821',uuid=08fa2836-717a-4893-8969-fcab677935a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converting VIF {"id": "90ce04e4-d390-4067-8a50-755e4964ab52", "address": "fa:16:3e:98:5a:5f", "network": {"id": "1a75c519-08ab-41df-9f54-466654913a16", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-770688469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9df48376ed604fc09522486062251014", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ce04e4-d3", "ovs_interfaceid": "90ce04e4-d390-4067-8a50-755e4964ab52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:5a:5f,bridge_name='br-int',has_traffic_filtering=True,id=90ce04e4-d390-4067-8a50-755e4964ab52,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ce04e4-d3') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_vif [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:5a:5f,bridge_name='br-int',has_traffic_filtering=True,id=90ce04e4-d390-4067-8a50-755e4964ab52,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ce04e4-d3') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90ce04e4-d3, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:38:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Creating image(s)
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Ensure instance console log exists: /opt/stack/data/nova/instances/4d9706b8-2a69-4272-89d3-f8a985e0ad2c/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Start _get_guest_xml network_info=[{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1952eddb-d5e6-4473-aa52-d79674bcbff6', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNljCLFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d9706b8-2a69-4272-89d3-f8a985e0ad2c', 'attached_at': '', 'detached_at': '', 'volume_id': 'abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'serial': 'abd3a4fb-7d3b-4cbc-a399-8aa59081943a'}, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:38:11 user nova-compute[70869]: INFO os_vif [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:5a:5f,bridge_name='br-int',has_traffic_filtering=True,id=90ce04e4-d390-4067-8a50-755e4964ab52,network=Network(1a75c519-08ab-41df-9f54-466654913a16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ce04e4-d3')
Jul 25 15:38:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Deleting instance files /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5_del
Jul 25 15:38:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Deletion of /opt/stack/data/nova/instances/08fa2836-717a-4893-8969-fcab677935a5_del complete
Jul 25 15:38:11 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:38:11 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNljCLFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:38:11 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:38:11 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:38:11 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: INFO nova.compute.manager [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Took 1.00 seconds to destroy the instance on the hypervisor.
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 08fa2836-717a-4893-8969-fcab677935a5] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[784194aa-714b-4a42-8261-9c24cd4113f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:38:11 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1657a22e-3633-4be8-bf3f-f95b8a8e5f9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a] added
Jul 25 15:38:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30e6c88-8593-4249-a75f-f418de25cf14]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45737bc-8484-4d5e-917b-517adb8adb03]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SNljCLFi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SNljCLFi" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e7aff7-1553-440e-8070-cff40923bf5f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SNljCLFi'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb3fdf1-c5d1-4806-977b-42b8280d65dc]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8808085-e731-4ba3-9320-2e399decf968]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:38:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:38:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c86d3-2b1f-46a5-9bbb-d32b0404a8e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260]
Jul 25 15:38:11 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260] successful.
Jul 25 15:38:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a22b31-d583-44d7-86cf-14d071ec0784]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8838e5e-e2c2-405d-935f-ba7bef880e77]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:38:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:38:11 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:38:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ae43b7-f7ab-494f-97ca-17d4e9ea727c]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNljCLFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23035393835313064', 'path': '/dev/sdf'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035393835313064', 'path': '/dev/sdf'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1120590963',display_name='tempest-TestShelveInstance-server-1120590963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1120590963',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIgLtUd6WGXmr6U7WthLqyhjTgPJ8c1kY/GE2MVvAA0fdKsiMoEQPcMEldthR7JieY77CD1/uKZkLQ4DWjjCVjLUomINTCZvIG2NVvpOQd+8k106ZkJRPzkRSKmT72jPg==',key_name='tempest-TestShelveInstance-1341964134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77781f71b0364014b1561b8158656565',ramdisk_id='',reservation_id='r-ax0saf22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2115421608',owner_user_name='tempest-TestShelveInstance-2115421608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:38:02Z,user_data=None,user_id='6af1342ac93849d995a457cde23bde41',uuid=4d9706b8-2a69-4272-89d3-f8a985e0ad2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converting VIF {"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d9706b8-2a69-4272-89d3-f8a985e0ad2c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:38:12 user nova-compute[70869]:   <uuid>4d9706b8-2a69-4272-89d3-f8a985e0ad2c</uuid>
Jul 25 15:38:12 user nova-compute[70869]:   <name>instance-00000014</name>
Jul 25 15:38:12 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:38:12 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:38:12 user nova-compute[70869]:   <metadata>
Jul 25 15:38:12 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:38:12 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:38:12 user nova-compute[70869]:       <nova:name>tempest-TestShelveInstance-server-1120590963</nova:name>
Jul 25 15:38:12 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:38:11</nova:creationTime>
Jul 25 15:38:12 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:38:12 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:38:12 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:38:12 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:38:12 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:38:12 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:38:12 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:38:12 user nova-compute[70869]:       <nova:owner>
Jul 25 15:38:12 user nova-compute[70869]:         <nova:user uuid="6af1342ac93849d995a457cde23bde41">tempest-TestShelveInstance-2115421608-project-member</nova:user>
Jul 25 15:38:12 user nova-compute[70869]:         <nova:project uuid="77781f71b0364014b1561b8158656565">tempest-TestShelveInstance-2115421608</nova:project>
Jul 25 15:38:12 user nova-compute[70869]:       </nova:owner>
Jul 25 15:38:12 user nova-compute[70869]:       <nova:ports>
Jul 25 15:38:12 user nova-compute[70869]:         <nova:port uuid="685fa69b-6fa0-4620-8367-c7363215995c">
Jul 25 15:38:12 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 15:38:12 user nova-compute[70869]:         </nova:port>
Jul 25 15:38:12 user nova-compute[70869]:       </nova:ports>
Jul 25 15:38:12 user nova-compute[70869]:     </nova:instance>
Jul 25 15:38:12 user nova-compute[70869]:   </metadata>
Jul 25 15:38:12 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:38:12 user nova-compute[70869]:     <system>
Jul 25 15:38:12 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:38:12 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:38:12 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:38:12 user nova-compute[70869]:       <entry name="serial">4d9706b8-2a69-4272-89d3-f8a985e0ad2c</entry>
Jul 25 15:38:12 user nova-compute[70869]:       <entry name="uuid">4d9706b8-2a69-4272-89d3-f8a985e0ad2c</entry>
Jul 25 15:38:12 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:38:12 user nova-compute[70869]:     </system>
Jul 25 15:38:12 user nova-compute[70869]:   </sysinfo>
Jul 25 15:38:12 user nova-compute[70869]:   <os>
Jul 25 15:38:12 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:38:12 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:38:12 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:38:12 user nova-compute[70869]:   </os>
Jul 25 15:38:12 user nova-compute[70869]:   <features>
Jul 25 15:38:12 user nova-compute[70869]:     <acpi/>
Jul 25 15:38:12 user nova-compute[70869]:     <apic/>
Jul 25 15:38:12 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:38:12 user nova-compute[70869]:   </features>
Jul 25 15:38:12 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:38:12 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:38:12 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:38:12 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:38:12 user nova-compute[70869]:   </clock>
Jul 25 15:38:12 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:38:12 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:38:12 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:38:12 user nova-compute[70869]:   </cpu>
Jul 25 15:38:12 user nova-compute[70869]:   <devices>
Jul 25 15:38:12 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:38:12 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:38:12 user nova-compute[70869]:       <source dev="/dev/sdf"/>
Jul 25 15:38:12 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:38:12 user nova-compute[70869]:       <serial>abd3a4fb-7d3b-4cbc-a399-8aa59081943a</serial>
Jul 25 15:38:12 user nova-compute[70869]:     </disk>
Jul 25 15:38:12 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:38:12 user nova-compute[70869]:       <mac address="fa:16:3e:5a:61:d5"/>
Jul 25 15:38:12 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:38:12 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:38:12 user nova-compute[70869]:       <target dev="tap685fa69b-6f"/>
Jul 25 15:38:12 user nova-compute[70869]:     </interface>
Jul 25 15:38:12 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:38:12 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/4d9706b8-2a69-4272-89d3-f8a985e0ad2c/console.log" append="off"/>
Jul 25 15:38:12 user nova-compute[70869]:     </serial>
Jul 25 15:38:12 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:38:12 user nova-compute[70869]:     <video>
Jul 25 15:38:12 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:38:12 user nova-compute[70869]:     </video>
Jul 25 15:38:12 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:38:12 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:38:12 user nova-compute[70869]:     </rng>
Jul 25 15:38:12 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:38:12 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:38:12 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:38:12 user nova-compute[70869]:     </memballoon>
Jul 25 15:38:12 user nova-compute[70869]:   </devices>
Jul 25 15:38:12 user nova-compute[70869]: </domain>
Jul 25 15:38:12 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1120590963',display_name='tempest-TestShelveInstance-server-1120590963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1120590963',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIgLtUd6WGXmr6U7WthLqyhjTgPJ8c1kY/GE2MVvAA0fdKsiMoEQPcMEldthR7JieY77CD1/uKZkLQ4DWjjCVjLUomINTCZvIG2NVvpOQd+8k106ZkJRPzkRSKmT72jPg==',key_name='tempest-TestShelveInstance-1341964134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77781f71b0364014b1561b8158656565',ramdisk_id='',reservation_id='r-ax0saf22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2115421608',owner_user_name='tempest-TestShelveInstance-2115421608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:38:02Z,user_data=None,user_id='6af1342ac93849d995a457cde23bde41',uuid=4d9706b8-2a69-4272-89d3-f8a985e0ad2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converting VIF {"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG os_vif [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap685fa69b-6f, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap685fa69b-6f, col_values=(('external_ids', {'iface-id': '685fa69b-6fa0-4620-8367-c7363215995c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:61:d5', 'vm-uuid': '4d9706b8-2a69-4272-89d3-f8a985e0ad2c'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] No waiting events found dispatching network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:12 user nova-compute[70869]: WARNING nova.compute.manager [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received unexpected event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 for instance with vm_state active and task_state deleting.
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] No waiting events found dispatching network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:12 user nova-compute[70869]: WARNING nova.compute.manager [req-8cf558bf-9fac-472d-876b-bbf866d812ef req-0c151d6a-63dd-4f60-ad07-3051dd1709ce service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received unexpected event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 for instance with vm_state active and task_state deleting.
Jul 25 15:38:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:12 user nova-compute[70869]: INFO os_vif [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f')
Jul 25 15:38:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:38:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] No VIF found with MAC fa:16:3e:5a:61:d5, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:38:13 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:38:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:13 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Took 1.97 seconds to deallocate network for instance.
Jul 25 15:38:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:13 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:38:13 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:38:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:13 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Deleted allocations for instance 08fa2836-717a-4893-8969-fcab677935a5
Jul 25 15:38:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ba803816-3cc3-42b2-af17-8c99a80fa5df tempest-VolumesAdminNegativeTest-45810269 tempest-VolumesAdminNegativeTest-45810269-project-member] Lock "08fa2836-717a-4893-8969-fcab677935a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.523s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:13 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299478.9817646, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:38:13 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] VM Stopped (Lifecycle Event)
Jul 25 15:38:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b19ad343-722c-42b0-ae55-f86f706f1171 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b19ad343-722c-42b0-ae55-f86f706f1171 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d159107-ba71-42fd-ba58-3bdb5f166008 req-7cc28e03-6376-49f8-8bad-8f32cb5219d7 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d159107-ba71-42fd-ba58-3bdb5f166008 req-7cc28e03-6376-49f8-8bad-8f32cb5219d7 service nova] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d159107-ba71-42fd-ba58-3bdb5f166008 req-7cc28e03-6376-49f8-8bad-8f32cb5219d7 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d159107-ba71-42fd-ba58-3bdb5f166008 req-7cc28e03-6376-49f8-8bad-8f32cb5219d7 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d159107-ba71-42fd-ba58-3bdb5f166008 req-7cc28e03-6376-49f8-8bad-8f32cb5219d7 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] No waiting events found dispatching network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:14 user nova-compute[70869]: WARNING nova.compute.manager [req-9d159107-ba71-42fd-ba58-3bdb5f166008 req-7cc28e03-6376-49f8-8bad-8f32cb5219d7 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received unexpected event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c for instance with vm_state building and task_state spawning.
Jul 25 15:38:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] No waiting events found dispatching network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:14 user nova-compute[70869]: WARNING nova.compute.manager [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received unexpected event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 for instance with vm_state deleted and task_state None.
Jul 25 15:38:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] Acquiring lock "08fa2836-717a-4893-8969-fcab677935a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] Lock "08fa2836-717a-4893-8969-fcab677935a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] No waiting events found dispatching network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:14 user nova-compute[70869]: WARNING nova.compute.manager [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received unexpected event network-vif-plugged-90ce04e4-d390-4067-8a50-755e4964ab52 for instance with vm_state deleted and task_state None.
Jul 25 15:38:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-d4b4975c-b0f4-4ab6-a268-f5e308f064ce req-3d438508-8484-4f4e-ad1e-b0824a8c7e81 service nova] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Received event network-vif-deleted-90ce04e4-d390-4067-8a50-755e4964ab52 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299496.5467057, 4d9706b8-2a69-4272-89d3-f8a985e0ad2c => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:38:16 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] VM Resumed (Lifecycle Event)
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:38:16 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Instance spawned successfully.
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:38:16 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299496.5482612, 4d9706b8-2a69-4272-89d3-f8a985e0ad2c => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:38:16 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] VM Started (Lifecycle Event)
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-f8befec1-3a16-426a-b49c-657e20587aab req-49b21a1d-48b4-4217-b204-70ef361f8f60 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f8befec1-3a16-426a-b49c-657e20587aab req-49b21a1d-48b4-4217-b204-70ef361f8f60 service nova] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f8befec1-3a16-426a-b49c-657e20587aab req-49b21a1d-48b4-4217-b204-70ef361f8f60 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f8befec1-3a16-426a-b49c-657e20587aab req-49b21a1d-48b4-4217-b204-70ef361f8f60 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-f8befec1-3a16-426a-b49c-657e20587aab req-49b21a1d-48b4-4217-b204-70ef361f8f60 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] No waiting events found dispatching network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:16 user nova-compute[70869]: WARNING nova.compute.manager [req-f8befec1-3a16-426a-b49c-657e20587aab req-49b21a1d-48b4-4217-b204-70ef361f8f60 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received unexpected event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c for instance with vm_state building and task_state spawning.
Jul 25 15:38:16 user nova-compute[70869]: INFO nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Took 5.32 seconds to spawn the instance on the hypervisor.
Jul 25 15:38:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:38:16 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:38:16 user nova-compute[70869]: INFO nova.compute.manager [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Took 15.97 seconds to build instance.
Jul 25 15:38:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c7a791a6-2a23-45db-a5e2-6e3adbd71ed3 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.077s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:25 user nova-compute[70869]: INFO nova.compute.manager [None req-6030fe42-2dbd-4820-99c4-d16de6b8ac06 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Unrescuing
Jul 25 15:38:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6030fe42-2dbd-4820-99c4-d16de6b8ac06 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:38:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6030fe42-2dbd-4820-99c4-d16de6b8ac06 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquired lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:38:25 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6030fe42-2dbd-4820-99c4-d16de6b8ac06 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299491.249023, 08fa2836-717a-4893-8969-fcab677935a5 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:38:26 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 08fa2836-717a-4893-8969-fcab677935a5] VM Stopped (Lifecycle Event)
Jul 25 15:38:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-489bc8a7-c250-415f-be70-4260ee2d597d None None] [instance: 08fa2836-717a-4893-8969-fcab677935a5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6030fe42-2dbd-4820-99c4-d16de6b8ac06 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updating instance_info_cache with network_info: [{"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6030fe42-2dbd-4820-99c4-d16de6b8ac06 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Releasing lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6030fe42-2dbd-4820-99c4-d16de6b8ac06 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'flavor' on Instance uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-f4cffc96-4c33-4093-9353-15c50fff8701 req-75f3836a-3ad4-470b-872b-6fb571d3c1a0 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-unplugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f4cffc96-4c33-4093-9353-15c50fff8701 req-75f3836a-3ad4-470b-872b-6fb571d3c1a0 service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f4cffc96-4c33-4093-9353-15c50fff8701 req-75f3836a-3ad4-470b-872b-6fb571d3c1a0 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f4cffc96-4c33-4093-9353-15c50fff8701 req-75f3836a-3ad4-470b-872b-6fb571d3c1a0 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-f4cffc96-4c33-4093-9353-15c50fff8701 req-75f3836a-3ad4-470b-872b-6fb571d3c1a0 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-unplugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:26 user nova-compute[70869]: WARNING nova.compute.manager [req-f4cffc96-4c33-4093-9353-15c50fff8701 req-75f3836a-3ad4-470b-872b-6fb571d3c1a0 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-unplugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:38:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:27 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Instance destroyed successfully.
Jul 25 15:38:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-ccae2792-0427-4a49-9b42-c4afcea6ea41 req-f881a669-5d2f-4ed6-bb37-6b0692527c11 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ccae2792-0427-4a49-9b42-c4afcea6ea41 req-f881a669-5d2f-4ed6-bb37-6b0692527c11 service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ccae2792-0427-4a49-9b42-c4afcea6ea41 req-f881a669-5d2f-4ed6-bb37-6b0692527c11 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ccae2792-0427-4a49-9b42-c4afcea6ea41 req-f881a669-5d2f-4ed6-bb37-6b0692527c11 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-ccae2792-0427-4a49-9b42-c4afcea6ea41 req-f881a669-5d2f-4ed6-bb37-6b0692527c11 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:28 user nova-compute[70869]: WARNING nova.compute.manager [req-ccae2792-0427-4a49-9b42-c4afcea6ea41 req-f881a669-5d2f-4ed6-bb37-6b0692527c11 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:38:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:30 user nova-compute[70869]: WARNING nova.compute.manager [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:38:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:30 user nova-compute[70869]: WARNING nova.compute.manager [req-59c91dcc-b549-4706-8547-e406d56e8806 req-2073a177-22a2-46d2-8cd8-d53de054d0bc service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:38:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:31 user nova-compute[70869]: INFO nova.compute.manager [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Terminating instance
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6030fe42-2dbd-4820-99c4-d16de6b8ac06 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for a525e472-1e7b-40b5-a4b1-5ba8bae313c9 due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299511.3728619, a525e472-1e7b-40b5-a4b1-5ba8bae313c9 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:38:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] VM Resumed (Lifecycle Event)
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:38:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299511.3731067, a525e472-1e7b-40b5-a4b1-5ba8bae313c9 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:38:31 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] VM Started (Lifecycle Event)
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.compute.manager [req-1b9ae67f-6fa2-4270-9836-c2faeabc8e7b req-760637eb-d675-441c-a36d-fd748cf477d2 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received event network-vif-unplugged-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1b9ae67f-6fa2-4270-9836-c2faeabc8e7b req-760637eb-d675-441c-a36d-fd748cf477d2 service nova] Acquiring lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1b9ae67f-6fa2-4270-9836-c2faeabc8e7b req-760637eb-d675-441c-a36d-fd748cf477d2 service nova] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1b9ae67f-6fa2-4270-9836-c2faeabc8e7b req-760637eb-d675-441c-a36d-fd748cf477d2 service nova] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.compute.manager [req-1b9ae67f-6fa2-4270-9836-c2faeabc8e7b req-760637eb-d675-441c-a36d-fd748cf477d2 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] No waiting events found dispatching network-vif-unplugged-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.compute.manager [req-1b9ae67f-6fa2-4270-9836-c2faeabc8e7b req-760637eb-d675-441c-a36d-fd748cf477d2 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received event network-vif-unplugged-2606ef46-4806-4296-b081-1e354878db1f for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:38:31 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:38:31 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Instance destroyed successfully.
Jul 25 15:38:31 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lazy-loading 'resources' on Instance uuid c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-679150226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-679150226',id=6,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd5ruZaws+3RLrARdKgK3cmlipmHN2NhoKSEL2XI1JlqdOPd5N5x9NV4Ofw/kMNgySHUP1LDOJI7s2MoBufg2/4aflCz0SM6ZcsFLhQtZmMGazc86LsU1BaJroeb181pA==',key_name='tempest-keypair-252354925',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:32:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27d4e6ad84894e2d8ca5aee1aa77db4e',ramdisk_id='',reservation_id='r-hujuwjkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1601506810',owner_user_name='tempest-ServerActionsV293TestJSON-1601506810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0d6af7f176145f382a7cc839ed2c027',uuid=c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converting VIF {"id": "2606ef46-4806-4296-b081-1e354878db1f", "address": "fa:16:3e:2d:63:8e", "network": {"id": "b329cd5b-8a61-4cff-bbe2-e1a2bef83341", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-156181667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27d4e6ad84894e2d8ca5aee1aa77db4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2606ef46-48", "ovs_interfaceid": "2606ef46-4806-4296-b081-1e354878db1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:63:8e,bridge_name='br-int',has_traffic_filtering=True,id=2606ef46-4806-4296-b081-1e354878db1f,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2606ef46-48') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG os_vif [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:63:8e,bridge_name='br-int',has_traffic_filtering=True,id=2606ef46-4806-4296-b081-1e354878db1f,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2606ef46-48') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2606ef46-48, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:32 user nova-compute[70869]: INFO os_vif [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:63:8e,bridge_name='br-int',has_traffic_filtering=True,id=2606ef46-4806-4296-b081-1e354878db1f,network=Network(b329cd5b-8a61-4cff-bbe2-e1a2bef83341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2606ef46-48')
Jul 25 15:38:32 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Deleting instance files /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36_del
Jul 25 15:38:32 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Deletion of /opt/stack/data/nova/instances/c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36_del complete
Jul 25 15:38:32 user nova-compute[70869]: INFO nova.compute.manager [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 25 15:38:32 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:38:32 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:38:32 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Took 0.86 seconds to deallocate network for instance.
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-1a46701c-9e9e-4b73-ad93-aa0aa76bc78c req-cd6b289f-6529-4c61-b89e-eec6b8f0cb04 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received event network-vif-deleted-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:33 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Deleted allocations for instance c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ec4f2736-8eb1-4b2f-983d-f4ee0d83cdd8 tempest-ServerActionsV293TestJSON-1601506810 tempest-ServerActionsV293TestJSON-1601506810-project-member] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-bcf3ad34-a7aa-468c-9502-ea5a0b27b9b0 req-a2a33994-98e4-42b2-8947-2082b042dbe3 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received event network-vif-plugged-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bcf3ad34-a7aa-468c-9502-ea5a0b27b9b0 req-a2a33994-98e4-42b2-8947-2082b042dbe3 service nova] Acquiring lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bcf3ad34-a7aa-468c-9502-ea5a0b27b9b0 req-a2a33994-98e4-42b2-8947-2082b042dbe3 service nova] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bcf3ad34-a7aa-468c-9502-ea5a0b27b9b0 req-a2a33994-98e4-42b2-8947-2082b042dbe3 service nova] Lock "c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-bcf3ad34-a7aa-468c-9502-ea5a0b27b9b0 req-a2a33994-98e4-42b2-8947-2082b042dbe3 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] No waiting events found dispatching network-vif-plugged-2606ef46-4806-4296-b081-1e354878db1f {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:33 user nova-compute[70869]: WARNING nova.compute.manager [req-bcf3ad34-a7aa-468c-9502-ea5a0b27b9b0 req-a2a33994-98e4-42b2-8947-2082b042dbe3 service nova] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Received unexpected event network-vif-plugged-2606ef46-4806-4296-b081-1e354878db1f for instance with vm_state deleted and task_state None.
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:38:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:38:36 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:38:36 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7483MB free_disk=25.493656158447266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fa170559-5228-448f-acea-c5b816a22631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 93dbd517-8be2-4529-8146-06720336034d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d384e3b6-8948-4db0-8d39-a340cb130c57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 4d9706b8-2a69-4272-89d3-f8a985e0ad2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:38:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:38:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:38:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:38:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:44 user nova-compute[70869]: INFO nova.compute.manager [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Detaching volume 2f9c954d-f52d-4445-b157-08bf6946d203
Jul 25 15:38:44 user nova-compute[70869]: INFO nova.virt.block_device [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Attempting to driver detach volume 2f9c954d-f52d-4445-b157-08bf6946d203 from mountpoint /dev/vdb
Jul 25 15:38:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Attempting to detach device vdb from instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:38:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:38:44 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:38:44 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:38:44 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:38:44 user nova-compute[70869]:   <serial>2f9c954d-f52d-4445-b157-08bf6946d203</serial>
Jul 25 15:38:44 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 15:38:44 user nova-compute[70869]: </disk>
Jul 25 15:38:44 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:38:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully detached device vdb from instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 from the persistent domain config.
Jul 25 15:38:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:38:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:38:44 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:38:44 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:38:44 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:38:44 user nova-compute[70869]:   <serial>2f9c954d-f52d-4445-b157-08bf6946d203</serial>
Jul 25 15:38:44 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 15:38:44 user nova-compute[70869]: </disk>
Jul 25 15:38:44 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299525.2541504, bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:38:45 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully detached device vdb from instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 from the live domain config.
Jul 25 15:38:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epzOyBXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:38:45 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[73032bad-fdcb-4ab4-a2ac-c0cfe838becb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:38:45 user nova-compute[70869]: No targets found.
Jul 25 15:38:45 user nova-compute[70869]: iSNS:
Jul 25 15:38:45 user nova-compute[70869]: No targets found.
Jul 25 15:38:45 user nova-compute[70869]: STATIC:
Jul 25 15:38:45 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16
Jul 25 15:38:45 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:38:45 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:38:45 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d
Jul 25 15:38:45 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:38:45 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:38:45 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203
Jul 25 15:38:45 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:38:45 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:38:45 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:38:45 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:38:45 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:38:45 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:38:45 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:38:45 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:38:45 user nova-compute[70869]: FIRMWARE:
Jul 25 15:38:45 user nova-compute[70869]: No targets found.
Jul 25 15:38:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:38:45 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:38:45 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bda9d01-ceeb-41bf-b206-78f725eee61c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdff8f8-8753-49f1-88ee-4362020da2a0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:38:45 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:38:45 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:38:45 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:38:45 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:38:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:38:45 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:38:45 user nova-compute[70869]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 (non-flash)
Jul 25 15:38:45 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:38:45 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:38:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4343c6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5265eb94-253a-41d5-864b-a4588dbfc88a]: (4, ('path checker states:\nup                  3\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1ec809-ec93-4645-8701-863c3c365532]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf0c562-6ed9-4590-b52b-964c0808f80b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b35d56-f815-4ef7-b530-ef2de7d8be5d]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aacc7ce-615a-4f89-a7f7-2006131f7d1e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e77458-fad8-4984-bf3f-add3c96a0efd]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260]
Jul 25 15:38:45 user nova-compute[70869]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203, portal: 172.16.0.220,3260] successful.
Jul 25 15:38:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f9c954d-f52d-4445-b157-08bf6946d203 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a405e6-ed42-46ad-8a77-f3f4dd67e6b1]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== disconnect_volume: return (338ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:45 user nova-compute[70869]: INFO nova.compute.manager [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Detaching volume cad17826-a657-4886-8a99-934a955ac72d
Jul 25 15:38:45 user nova-compute[70869]: INFO nova.virt.block_device [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Attempting to driver detach volume cad17826-a657-4886-8a99-934a955ac72d from mountpoint /dev/vdb
Jul 25 15:38:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Attempting to detach device vdb from instance fa170559-5228-448f-acea-c5b816a22631 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:38:45 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:38:45 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:38:45 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:38:45 user nova-compute[70869]:   <serial>cad17826-a657-4886-8a99-934a955ac72d</serial>
Jul 25 15:38:45 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:38:45 user nova-compute[70869]: </disk>
Jul 25 15:38:45 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:38:45 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Successfully detached device vdb from instance fa170559-5228-448f-acea-c5b816a22631 from the persistent domain config.
Jul 25 15:38:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa170559-5228-448f-acea-c5b816a22631 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:38:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:38:45 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:38:45 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:38:45 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:38:45 user nova-compute[70869]:   <serial>cad17826-a657-4886-8a99-934a955ac72d</serial>
Jul 25 15:38:45 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:38:45 user nova-compute[70869]: </disk>
Jul 25 15:38:45 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'flavor' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dafa83b0-3092-4a38-9c0e-d81d64c13798 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299526.4308164, fa170559-5228-448f-acea-c5b816a22631 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:38:46 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Successfully detached device vdb from instance fa170559-5228-448f-acea-c5b816a22631 from the live domain config.
Jul 25 15:38:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXMCkbBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:38:46 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f45d6d-8a08-4cf1-aaa8-be409ea3bb51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:38:46 user nova-compute[70869]: No targets found.
Jul 25 15:38:46 user nova-compute[70869]: iSNS:
Jul 25 15:38:46 user nova-compute[70869]: No targets found.
Jul 25 15:38:46 user nova-compute[70869]: STATIC:
Jul 25 15:38:46 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16
Jul 25 15:38:46 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:38:46 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:38:46 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d
Jul 25 15:38:46 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:38:46 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:38:46 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:38:46 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:38:46 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:38:46 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:38:46 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:38:46 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:38:46 user nova-compute[70869]: FIRMWARE:
Jul 25 15:38:46 user nova-compute[70869]: No targets found.
Jul 25 15:38:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:38:46 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:38:46 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c25903-64c5-472e-9042-7b437a7da610]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8feb9f5-84e0-4fb6-9a13-4b7233a4e0fc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:38:46 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:38:46 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:38:46 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:38:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:38:46 user nova-compute[70869]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d (non-flash)
Jul 25 15:38:46 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:38:46 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:38:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4430b01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc465b5-207d-4dae-bbbd-6bd08094226d]: (4, ('path checker states:\nup                  2\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e30387-ebee-4d67-86b5-9f013d2624b7]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bd3a9d-5e03-45f5-9a6b-ad4ab9b1d17d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeac2ad-d117-4afe-9030-85d9251698bb]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c2d27e-c592-4a17-9795-9368164e5567]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[727f25bb-7566-4f7c-badf-fe5261916434]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d, portal: 172.16.0.220,3260]
Jul 25 15:38:46 user nova-compute[70869]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d, portal: 172.16.0.220,3260] successful.
Jul 25 15:38:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad17826-a657-4886-8a99-934a955ac72d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b985bde7-1118-4978-a26d-e619b15df29a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] <== disconnect_volume: return (313ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:38:46 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299511.9828045, c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:38:46 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] VM Stopped (Lifecycle Event)
Jul 25 15:38:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-103d8323-db8c-4686-a4ec-e8e914e3a8ea None None] [instance: c9ebc17e-3a29-4c0e-bfc2-802c7bfdcd36] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:38:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:47 user nova-compute[70869]: DEBUG nova.objects.instance [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'flavor' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:38:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-92b974dc-5040-42ce-8fad-23c1bd6bfd12 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "93dbd517-8be2-4529-8146-06720336034d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "93dbd517-8be2-4529-8146-06720336034d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "93dbd517-8be2-4529-8146-06720336034d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "93dbd517-8be2-4529-8146-06720336034d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "93dbd517-8be2-4529-8146-06720336034d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:55 user nova-compute[70869]: INFO nova.compute.manager [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Terminating instance
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.compute.manager [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-88b30c1e-37ab-4fbd-b1d3-67a227b0512f req-b1fb5bf6-4e5b-49da-ab8e-7e09d2dcf26e service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received event network-vif-unplugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-88b30c1e-37ab-4fbd-b1d3-67a227b0512f req-b1fb5bf6-4e5b-49da-ab8e-7e09d2dcf26e service nova] Acquiring lock "93dbd517-8be2-4529-8146-06720336034d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-88b30c1e-37ab-4fbd-b1d3-67a227b0512f req-b1fb5bf6-4e5b-49da-ab8e-7e09d2dcf26e service nova] Lock "93dbd517-8be2-4529-8146-06720336034d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-88b30c1e-37ab-4fbd-b1d3-67a227b0512f req-b1fb5bf6-4e5b-49da-ab8e-7e09d2dcf26e service nova] Lock "93dbd517-8be2-4529-8146-06720336034d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-88b30c1e-37ab-4fbd-b1d3-67a227b0512f req-b1fb5bf6-4e5b-49da-ab8e-7e09d2dcf26e service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] No waiting events found dispatching network-vif-unplugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-88b30c1e-37ab-4fbd-b1d3-67a227b0512f req-b1fb5bf6-4e5b-49da-ab8e-7e09d2dcf26e service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received event network-vif-unplugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:38:55 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 93dbd517-8be2-4529-8146-06720336034d] Instance destroyed successfully.
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.objects.instance [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lazy-loading 'resources' on Instance uuid 93dbd517-8be2-4529-8146-06720336034d {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1754513723',display_name='tempest-VolumesActionsTest-instance-1754513723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1754513723',id=18,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:37:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a813ccd5a13f4ec689ef47b069c02448',ramdisk_id='',reservation_id='r-v64uqlqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1245951475',owner_user_name='tempest-VolumesActionsTest-1245951475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:37:13Z,user_data=None,user_id='522c108f563c4c18a2054332549bc66a',uuid=93dbd517-8be2-4529-8146-06720336034d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converting VIF {"id": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "address": "fa:16:3e:eb:67:b9", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b0a9e-6f", "ovs_interfaceid": "5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b0a9e-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG os_vif [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b0a9e-6f') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d3b0a9e-6f, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:38:55 user nova-compute[70869]: INFO os_vif [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b0a9e-6f')
Jul 25 15:38:55 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Deleting instance files /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d_del
Jul 25 15:38:55 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Deletion of /opt/stack/data/nova/instances/93dbd517-8be2-4529-8146-06720336034d_del complete
Jul 25 15:38:55 user nova-compute[70869]: INFO nova.compute.manager [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 93dbd517-8be2-4529-8146-06720336034d] Took 0.68 seconds to destroy the instance on the hypervisor.
Jul 25 15:38:55 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 93dbd517-8be2-4529-8146-06720336034d] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:38:55 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 93dbd517-8be2-4529-8146-06720336034d] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:38:56 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 93dbd517-8be2-4529-8146-06720336034d] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:38:56 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 93dbd517-8be2-4529-8146-06720336034d] Took 0.57 seconds to deallocate network for instance.
Jul 25 15:38:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-377efb55-400f-44ad-b381-587fb16e35e5 req-9bc12da6-3a18-433e-90ec-7537178cf004 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received event network-vif-deleted-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:56 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:38:56 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:38:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:56 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Deleted allocations for instance 93dbd517-8be2-4529-8146-06720336034d
Jul 25 15:38:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-20193378-a97b-4acd-86b8-60a3d2736a6a tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "93dbd517-8be2-4529-8146-06720336034d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.725s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-ee945db3-deb3-4c3d-b48c-7c2412544665 req-7d8a2cbb-f317-4012-bf43-fdac63f84956 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received event network-vif-plugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:38:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ee945db3-deb3-4c3d-b48c-7c2412544665 req-7d8a2cbb-f317-4012-bf43-fdac63f84956 service nova] Acquiring lock "93dbd517-8be2-4529-8146-06720336034d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:38:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ee945db3-deb3-4c3d-b48c-7c2412544665 req-7d8a2cbb-f317-4012-bf43-fdac63f84956 service nova] Lock "93dbd517-8be2-4529-8146-06720336034d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:38:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ee945db3-deb3-4c3d-b48c-7c2412544665 req-7d8a2cbb-f317-4012-bf43-fdac63f84956 service nova] Lock "93dbd517-8be2-4529-8146-06720336034d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:38:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-ee945db3-deb3-4c3d-b48c-7c2412544665 req-7d8a2cbb-f317-4012-bf43-fdac63f84956 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] No waiting events found dispatching network-vif-plugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:38:57 user nova-compute[70869]: WARNING nova.compute.manager [req-ee945db3-deb3-4c3d-b48c-7c2412544665 req-7d8a2cbb-f317-4012-bf43-fdac63f84956 service nova] [instance: 93dbd517-8be2-4529-8146-06720336034d] Received unexpected event network-vif-plugged-5d3b0a9e-6fc5-48ca-8e90-092ac1de3aa6 for instance with vm_state deleted and task_state None.
Jul 25 15:38:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-52cf8635-844d-494b-82f5-b110e4b83252 req-fdccc44c-7057-4b16-b10d-bd073a479122 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-changed-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-52cf8635-844d-494b-82f5-b110e4b83252 req-fdccc44c-7057-4b16-b10d-bd073a479122 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Refreshing instance network info cache due to event network-changed-eebac77a-9411-485f-b850-c2798d0b4b24. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:39:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-52cf8635-844d-494b-82f5-b110e4b83252 req-fdccc44c-7057-4b16-b10d-bd073a479122 service nova] Acquiring lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-52cf8635-844d-494b-82f5-b110e4b83252 req-fdccc44c-7057-4b16-b10d-bd073a479122 service nova] Acquired lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-52cf8635-844d-494b-82f5-b110e4b83252 req-fdccc44c-7057-4b16-b10d-bd073a479122 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Refreshing network info cache for port eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:39:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-52cf8635-844d-494b-82f5-b110e4b83252 req-fdccc44c-7057-4b16-b10d-bd073a479122 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updated VIF entry in instance network info cache for port eebac77a-9411-485f-b850-c2798d0b4b24. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:39:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-52cf8635-844d-494b-82f5-b110e4b83252 req-fdccc44c-7057-4b16-b10d-bd073a479122 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance_info_cache with network_info: [{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-52cf8635-844d-494b-82f5-b110e4b83252 req-fdccc44c-7057-4b16-b10d-bd073a479122 service nova] Releasing lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:10 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299535.7411513, 93dbd517-8be2-4529-8146-06720336034d => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:39:10 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 93dbd517-8be2-4529-8146-06720336034d] VM Stopped (Lifecycle Event)
Jul 25 15:39:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-01cdfefa-c1db-4766-aa61-5593827f571d None None] [instance: 93dbd517-8be2-4529-8146-06720336034d] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:39:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:24 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:39:24 user nova-compute[70869]: INFO nova.compute.claims [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Claim successful on node user
Jul 25 15:39:24 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:39:24 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:39:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.network.neutron [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:39:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.policy [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36d974eda33840e49deae13024233178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed694bf0a94479da8c2083d9c08ab70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:39:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Creating image(s)
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "/opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "/opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "/opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk 1073741824" returned: 0 in 0.052s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.181s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Cannot resize image /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.objects.instance [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lazy-loading 'migration_context' on Instance uuid be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Ensure instance console log exists: /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:26 user nova-compute[70869]: DEBUG nova.network.neutron [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Successfully created port: f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:39:27 user nova-compute[70869]: DEBUG nova.network.neutron [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Successfully updated port: f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:39:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "refresh_cache-be3bdffd-27ff-49a8-9aef-ddf374f33752" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquired lock "refresh_cache-be3bdffd-27ff-49a8-9aef-ddf374f33752" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:27 user nova-compute[70869]: DEBUG nova.network.neutron [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:39:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-c15468a3-68ab-48c7-9f9e-8dd9625793e2 req-8ff508c2-0108-4b47-b051-a79eb0099108 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-changed-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-c15468a3-68ab-48c7-9f9e-8dd9625793e2 req-8ff508c2-0108-4b47-b051-a79eb0099108 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Refreshing instance network info cache due to event network-changed-f71a78b3-ec67-4803-95e3-2490492edd10. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:39:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c15468a3-68ab-48c7-9f9e-8dd9625793e2 req-8ff508c2-0108-4b47-b051-a79eb0099108 service nova] Acquiring lock "refresh_cache-be3bdffd-27ff-49a8-9aef-ddf374f33752" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.network.neutron [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.network.neutron [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Updating instance_info_cache with network_info: [{"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Releasing lock "refresh_cache-be3bdffd-27ff-49a8-9aef-ddf374f33752" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Instance network_info: |[{"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c15468a3-68ab-48c7-9f9e-8dd9625793e2 req-8ff508c2-0108-4b47-b051-a79eb0099108 service nova] Acquired lock "refresh_cache-be3bdffd-27ff-49a8-9aef-ddf374f33752" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.network.neutron [req-c15468a3-68ab-48c7-9f9e-8dd9625793e2 req-8ff508c2-0108-4b47-b051-a79eb0099108 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Refreshing network info cache for port f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Start _get_guest_xml network_info=[{"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:39:28 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:39:28 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-316945857',display_name='tempest-TestServerVolumeAttachmentScenario-server-316945857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-316945857',id=21,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRM9bWvSN9pFLXMwDnvRWq2QcAhd2QrDqJ88M/bK5EjVzkWTG1k2E2n6gKDBJoMQTlOimf7mYmnRLKAXXn63tYJkwfYY1T0EmgeQWzck3t0Ha2iUYNQU5EC9Z6eil/gUQ==',key_name='tempest-keypair-1489029153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eed694bf0a94479da8c2083d9c08ab70',ramdisk_id='',reservation_id='r-eeupjgo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2135956578',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2135956578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:39:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36d974eda33840e49deae13024233178',uuid=be3bdffd-27ff-49a8-9aef-ddf374f33752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Converting VIF {"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:42:48,bridge_name='br-int',has_traffic_filtering=True,id=f71a78b3-ec67-4803-95e3-2490492edd10,network=Network(48088fa9-9260-4681-98cc-3ad5054a89ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71a78b3-ec') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.objects.instance [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lazy-loading 'pci_devices' on Instance uuid be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:39:28 user nova-compute[70869]:   <uuid>be3bdffd-27ff-49a8-9aef-ddf374f33752</uuid>
Jul 25 15:39:28 user nova-compute[70869]:   <name>instance-00000015</name>
Jul 25 15:39:28 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:39:28 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:39:28 user nova-compute[70869]:   <metadata>
Jul 25 15:39:28 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:39:28 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:39:28 user nova-compute[70869]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-316945857</nova:name>
Jul 25 15:39:28 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:39:28</nova:creationTime>
Jul 25 15:39:28 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:39:28 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:39:28 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:39:28 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:39:28 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:39:28 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:39:28 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:39:28 user nova-compute[70869]:       <nova:owner>
Jul 25 15:39:28 user nova-compute[70869]:         <nova:user uuid="36d974eda33840e49deae13024233178">tempest-TestServerVolumeAttachmentScenario-2135956578-project-member</nova:user>
Jul 25 15:39:28 user nova-compute[70869]:         <nova:project uuid="eed694bf0a94479da8c2083d9c08ab70">tempest-TestServerVolumeAttachmentScenario-2135956578</nova:project>
Jul 25 15:39:28 user nova-compute[70869]:       </nova:owner>
Jul 25 15:39:28 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:39:28 user nova-compute[70869]:       <nova:ports>
Jul 25 15:39:28 user nova-compute[70869]:         <nova:port uuid="f71a78b3-ec67-4803-95e3-2490492edd10">
Jul 25 15:39:28 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 15:39:28 user nova-compute[70869]:         </nova:port>
Jul 25 15:39:28 user nova-compute[70869]:       </nova:ports>
Jul 25 15:39:28 user nova-compute[70869]:     </nova:instance>
Jul 25 15:39:28 user nova-compute[70869]:   </metadata>
Jul 25 15:39:28 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:39:28 user nova-compute[70869]:     <system>
Jul 25 15:39:28 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:39:28 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:39:28 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:39:28 user nova-compute[70869]:       <entry name="serial">be3bdffd-27ff-49a8-9aef-ddf374f33752</entry>
Jul 25 15:39:28 user nova-compute[70869]:       <entry name="uuid">be3bdffd-27ff-49a8-9aef-ddf374f33752</entry>
Jul 25 15:39:28 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:39:28 user nova-compute[70869]:     </system>
Jul 25 15:39:28 user nova-compute[70869]:   </sysinfo>
Jul 25 15:39:28 user nova-compute[70869]:   <os>
Jul 25 15:39:28 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:39:28 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:39:28 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:39:28 user nova-compute[70869]:   </os>
Jul 25 15:39:28 user nova-compute[70869]:   <features>
Jul 25 15:39:28 user nova-compute[70869]:     <acpi/>
Jul 25 15:39:28 user nova-compute[70869]:     <apic/>
Jul 25 15:39:28 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:39:28 user nova-compute[70869]:   </features>
Jul 25 15:39:28 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:39:28 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:39:28 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:39:28 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:39:28 user nova-compute[70869]:   </clock>
Jul 25 15:39:28 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:39:28 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:39:28 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:39:28 user nova-compute[70869]:   </cpu>
Jul 25 15:39:28 user nova-compute[70869]:   <devices>
Jul 25 15:39:28 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:39:28 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:39:28 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk"/>
Jul 25 15:39:28 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:39:28 user nova-compute[70869]:     </disk>
Jul 25 15:39:28 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:39:28 user nova-compute[70869]:       <mac address="fa:16:3e:39:42:48"/>
Jul 25 15:39:28 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:39:28 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:39:28 user nova-compute[70869]:       <target dev="tapf71a78b3-ec"/>
Jul 25 15:39:28 user nova-compute[70869]:     </interface>
Jul 25 15:39:28 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:39:28 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/console.log" append="off"/>
Jul 25 15:39:28 user nova-compute[70869]:     </serial>
Jul 25 15:39:28 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:39:28 user nova-compute[70869]:     <video>
Jul 25 15:39:28 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:39:28 user nova-compute[70869]:     </video>
Jul 25 15:39:28 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:39:28 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:39:28 user nova-compute[70869]:     </rng>
Jul 25 15:39:28 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:39:28 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:39:28 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:39:28 user nova-compute[70869]:     </memballoon>
Jul 25 15:39:28 user nova-compute[70869]:   </devices>
Jul 25 15:39:28 user nova-compute[70869]: </domain>
Jul 25 15:39:28 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-316945857',display_name='tempest-TestServerVolumeAttachmentScenario-server-316945857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-316945857',id=21,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRM9bWvSN9pFLXMwDnvRWq2QcAhd2QrDqJ88M/bK5EjVzkWTG1k2E2n6gKDBJoMQTlOimf7mYmnRLKAXXn63tYJkwfYY1T0EmgeQWzck3t0Ha2iUYNQU5EC9Z6eil/gUQ==',key_name='tempest-keypair-1489029153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eed694bf0a94479da8c2083d9c08ab70',ramdisk_id='',reservation_id='r-eeupjgo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2135956578',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2135956578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:39:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36d974eda33840e49deae13024233178',uuid=be3bdffd-27ff-49a8-9aef-ddf374f33752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Converting VIF {"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:42:48,bridge_name='br-int',has_traffic_filtering=True,id=f71a78b3-ec67-4803-95e3-2490492edd10,network=Network(48088fa9-9260-4681-98cc-3ad5054a89ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71a78b3-ec') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG os_vif [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:42:48,bridge_name='br-int',has_traffic_filtering=True,id=f71a78b3-ec67-4803-95e3-2490492edd10,network=Network(48088fa9-9260-4681-98cc-3ad5054a89ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71a78b3-ec') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf71a78b3-ec, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf71a78b3-ec, col_values=(('external_ids', {'iface-id': 'f71a78b3-ec67-4803-95e3-2490492edd10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:42:48', 'vm-uuid': 'be3bdffd-27ff-49a8-9aef-ddf374f33752'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:28 user nova-compute[70869]: INFO os_vif [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:42:48,bridge_name='br-int',has_traffic_filtering=True,id=f71a78b3-ec67-4803-95e3-2490492edd10,network=Network(48088fa9-9260-4681-98cc-3ad5054a89ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71a78b3-ec')
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:39:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] No VIF found with MAC fa:16:3e:39:42:48, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:39:29 user nova-compute[70869]: DEBUG nova.network.neutron [req-c15468a3-68ab-48c7-9f9e-8dd9625793e2 req-8ff508c2-0108-4b47-b051-a79eb0099108 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Updated VIF entry in instance network info cache for port f71a78b3-ec67-4803-95e3-2490492edd10. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:39:29 user nova-compute[70869]: DEBUG nova.network.neutron [req-c15468a3-68ab-48c7-9f9e-8dd9625793e2 req-8ff508c2-0108-4b47-b051-a79eb0099108 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Updating instance_info_cache with network_info: [{"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c15468a3-68ab-48c7-9f9e-8dd9625793e2 req-8ff508c2-0108-4b47-b051-a79eb0099108 service nova] Releasing lock "refresh_cache-be3bdffd-27ff-49a8-9aef-ddf374f33752" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-9ca4bb56-e176-47ca-ab2c-6640a7635d41 req-38032f87-c7c9-4823-9a72-f996407b0222 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9ca4bb56-e176-47ca-ab2c-6640a7635d41 req-38032f87-c7c9-4823-9a72-f996407b0222 service nova] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9ca4bb56-e176-47ca-ab2c-6640a7635d41 req-38032f87-c7c9-4823-9a72-f996407b0222 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9ca4bb56-e176-47ca-ab2c-6640a7635d41 req-38032f87-c7c9-4823-9a72-f996407b0222 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-9ca4bb56-e176-47ca-ab2c-6640a7635d41 req-38032f87-c7c9-4823-9a72-f996407b0222 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] No waiting events found dispatching network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:30 user nova-compute[70869]: WARNING nova.compute.manager [req-9ca4bb56-e176-47ca-ab2c-6640a7635d41 req-38032f87-c7c9-4823-9a72-f996407b0222 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received unexpected event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 for instance with vm_state building and task_state spawning.
Jul 25 15:39:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:31 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299572.4526489, be3bdffd-27ff-49a8-9aef-ddf374f33752 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:39:32 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] VM Resumed (Lifecycle Event)
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:39:32 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Instance spawned successfully.
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:32 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299572.454686, be3bdffd-27ff-49a8-9aef-ddf374f33752 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:39:32 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] VM Started (Lifecycle Event)
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:39:32 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:39:32 user nova-compute[70869]: INFO nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Took 7.39 seconds to spawn the instance on the hypervisor.
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-2048d620-b65b-4b78-b358-7759ee8a46d0 req-5d67c515-1777-48eb-946f-c540c8130664 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2048d620-b65b-4b78-b358-7759ee8a46d0 req-5d67c515-1777-48eb-946f-c540c8130664 service nova] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2048d620-b65b-4b78-b358-7759ee8a46d0 req-5d67c515-1777-48eb-946f-c540c8130664 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2048d620-b65b-4b78-b358-7759ee8a46d0 req-5d67c515-1777-48eb-946f-c540c8130664 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-2048d620-b65b-4b78-b358-7759ee8a46d0 req-5d67c515-1777-48eb-946f-c540c8130664 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] No waiting events found dispatching network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:32 user nova-compute[70869]: WARNING nova.compute.manager [req-2048d620-b65b-4b78-b358-7759ee8a46d0 req-5d67c515-1777-48eb-946f-c540c8130664 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received unexpected event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 for instance with vm_state building and task_state spawning.
Jul 25 15:39:32 user nova-compute[70869]: INFO nova.compute.manager [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Took 8.13 seconds to build instance.
Jul 25 15:39:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43d27469-2adf-4282-a912-1490b62a99de tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.258s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:39:32 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid 8beb6a74-a413-4a75-b8ce-678447cff1a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Updating instance_info_cache with network_info: [{"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-8beb6a74-a413-4a75-b8ce-678447cff1a5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:39:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:39:36 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:39:36 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7777MB free_disk=25.50792694091797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fa170559-5228-448f-acea-c5b816a22631 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d384e3b6-8948-4db0-8d39-a340cb130c57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 4d9706b8-2a69-4272-89d3-f8a985e0ad2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance be3bdffd-27ff-49a8-9aef-ddf374f33752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:39:36 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:39:37 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:39:37 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:39:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:39:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:39:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:39:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:42 user nova-compute[70869]: INFO nova.compute.manager [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Terminating instance
Jul 25 15:39:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-60e759d9-86ea-4e6e-90fd-92c5a78fc091 req-ab507c07-a10d-441a-9341-1d2cd78f64b0 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-unplugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-60e759d9-86ea-4e6e-90fd-92c5a78fc091 req-ab507c07-a10d-441a-9341-1d2cd78f64b0 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-60e759d9-86ea-4e6e-90fd-92c5a78fc091 req-ab507c07-a10d-441a-9341-1d2cd78f64b0 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-60e759d9-86ea-4e6e-90fd-92c5a78fc091 req-ab507c07-a10d-441a-9341-1d2cd78f64b0 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-60e759d9-86ea-4e6e-90fd-92c5a78fc091 req-ab507c07-a10d-441a-9341-1d2cd78f64b0 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-unplugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-60e759d9-86ea-4e6e-90fd-92c5a78fc091 req-ab507c07-a10d-441a-9341-1d2cd78f64b0 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-unplugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:39:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fa170559-5228-448f-acea-c5b816a22631] Instance destroyed successfully.
Jul 25 15:39:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lazy-loading 'resources' on Instance uuid fa170559-5228-448f-acea-c5b816a22631 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-784113893',display_name='tempest-ServerStableDeviceRescueTest-server-784113893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-784113893',id=4,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZWkhEQZxma12rR0Om4x7WfDpt9pkLgXCaUDIjtRJgMe9oRuMvxIcGNqAesWThKH7m+GTrLgb/QUJ6B9QTZKJwX9sDX9n9SktFLsQ1Vx0ZmhGg8z7/yAeym8MbDarhpiw==',key_name='tempest-keypair-1975963349',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:35:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3780103999341dfa03d761707294bbd',ramdisk_id='',reservation_id='r-kjuq3luj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-464827475',owner_user_name='tempest-ServerStableDeviceRescueTest-464827475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b78b568f3a4845f081f3ceceb051ada0',uuid=fa170559-5228-448f-acea-c5b816a22631,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Converting VIF {"id": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "address": "fa:16:3e:30:bc:ad", "network": {"id": "947170b3-5f57-43a6-a8a1-c3d4ae38a0e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-129909389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3780103999341dfa03d761707294bbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb512c720-cc", "ovs_interfaceid": "b512c720-cc12-4cbd-98b1-62b64bc2a752", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:39:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=b512c720-cc12-4cbd-98b1-62b64bc2a752,network=Network(947170b3-5f57-43a6-a8a1-c3d4ae38a0e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb512c720-cc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:39:43 user nova-compute[70869]: DEBUG os_vif [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=b512c720-cc12-4cbd-98b1-62b64bc2a752,network=Network(947170b3-5f57-43a6-a8a1-c3d4ae38a0e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb512c720-cc') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:39:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb512c720-cc, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:39:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:43 user nova-compute[70869]: INFO os_vif [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=b512c720-cc12-4cbd-98b1-62b64bc2a752,network=Network(947170b3-5f57-43a6-a8a1-c3d4ae38a0e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb512c720-cc')
Jul 25 15:39:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Deleting instance files /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631_del
Jul 25 15:39:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Deletion of /opt/stack/data/nova/instances/fa170559-5228-448f-acea-c5b816a22631_del complete
Jul 25 15:39:43 user nova-compute[70869]: INFO nova.compute.manager [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] [instance: fa170559-5228-448f-acea-c5b816a22631] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 25 15:39:43 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:39:43 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: fa170559-5228-448f-acea-c5b816a22631] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:39:43 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: fa170559-5228-448f-acea-c5b816a22631] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:39:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: fa170559-5228-448f-acea-c5b816a22631] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:44 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: fa170559-5228-448f-acea-c5b816a22631] Took 1.01 seconds to deallocate network for instance.
Jul 25 15:39:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:44 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Deleted allocations for instance fa170559-5228-448f-acea-c5b816a22631
Jul 25 15:39:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-80a55ede-45e1-4349-8739-5830b36fc129 tempest-ServerStableDeviceRescueTest-464827475 tempest-ServerStableDeviceRescueTest-464827475-project-member] Lock "fa170559-5228-448f-acea-c5b816a22631" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.472s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-a338dac8-7af5-4367-8eea-546c848aaccd req-f99dcabb-1378-4a83-b817-b194e7618304 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a338dac8-7af5-4367-8eea-546c848aaccd req-f99dcabb-1378-4a83-b817-b194e7618304 service nova] Acquiring lock "fa170559-5228-448f-acea-c5b816a22631-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a338dac8-7af5-4367-8eea-546c848aaccd req-f99dcabb-1378-4a83-b817-b194e7618304 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a338dac8-7af5-4367-8eea-546c848aaccd req-f99dcabb-1378-4a83-b817-b194e7618304 service nova] Lock "fa170559-5228-448f-acea-c5b816a22631-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-a338dac8-7af5-4367-8eea-546c848aaccd req-f99dcabb-1378-4a83-b817-b194e7618304 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] No waiting events found dispatching network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:44 user nova-compute[70869]: WARNING nova.compute.manager [req-a338dac8-7af5-4367-8eea-546c848aaccd req-f99dcabb-1378-4a83-b817-b194e7618304 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received unexpected event network-vif-plugged-b512c720-cc12-4cbd-98b1-62b64bc2a752 for instance with vm_state deleted and task_state None.
Jul 25 15:39:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-a338dac8-7af5-4367-8eea-546c848aaccd req-f99dcabb-1378-4a83-b817-b194e7618304 service nova] [instance: fa170559-5228-448f-acea-c5b816a22631] Received event network-vif-deleted-b512c720-cc12-4cbd-98b1-62b64bc2a752 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:39:47 user nova-compute[70869]: INFO nova.compute.claims [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Claim successful on node user
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:39:47 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.policy [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '522c108f563c4c18a2054332549bc66a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a813ccd5a13f4ec689ef47b069c02448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:39:47 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Creating image(s)
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "/opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "/opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "/opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.162s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk 1073741824" returned: 0 in 0.052s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Successfully created port: 5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Cannot resize image /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lazy-loading 'migration_context' on Instance uuid 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Ensure instance console log exists: /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquired lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'info_cache' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Successfully updated port: 5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "refresh_cache-23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquired lock "refresh_cache-23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-dc972c44-a812-496c-b597-b1d51d3788a3 req-9cd43796-2ec5-40fc-9f0b-e43eb74d9307 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-changed-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-dc972c44-a812-496c-b597-b1d51d3788a3 req-9cd43796-2ec5-40fc-9f0b-e43eb74d9307 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Refreshing instance network info cache due to event network-changed-5b396992-40d9-402a-8163-dbf99fb727bf. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dc972c44-a812-496c-b597-b1d51d3788a3 req-9cd43796-2ec5-40fc-9f0b-e43eb74d9307 service nova] Acquiring lock "refresh_cache-23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Updating instance_info_cache with network_info: [{"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Releasing lock "refresh_cache-23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Instance network_info: |[{"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dc972c44-a812-496c-b597-b1d51d3788a3 req-9cd43796-2ec5-40fc-9f0b-e43eb74d9307 service nova] Acquired lock "refresh_cache-23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.neutron [req-dc972c44-a812-496c-b597-b1d51d3788a3 req-9cd43796-2ec5-40fc-9f0b-e43eb74d9307 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Refreshing network info cache for port 5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Start _get_guest_xml network_info=[{"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:39:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:39:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-762095310',display_name='tempest-VolumesActionsTest-instance-762095310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-762095310',id=22,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813ccd5a13f4ec689ef47b069c02448',ramdisk_id='',reservation_id='r-ev3al2xi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1245951475',owner_user_name='tempest-VolumesActionsTest-1245951475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:39:48Z,user_data=None,user_id='522c108f563c4c18a2054332549bc66a',uuid=23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converting VIF {"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b3:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b396992-40d9-402a-8163-dbf99fb727bf,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b396992-40') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lazy-loading 'pci_devices' on Instance uuid 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updating instance_info_cache with network_info: [{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:39:49 user nova-compute[70869]:   <uuid>23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9</uuid>
Jul 25 15:39:49 user nova-compute[70869]:   <name>instance-00000016</name>
Jul 25 15:39:49 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:39:49 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:39:49 user nova-compute[70869]:   <metadata>
Jul 25 15:39:49 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:39:49 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:39:49 user nova-compute[70869]:       <nova:name>tempest-VolumesActionsTest-instance-762095310</nova:name>
Jul 25 15:39:49 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:39:49</nova:creationTime>
Jul 25 15:39:49 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:39:49 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:39:49 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:39:49 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:39:49 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:39:49 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:39:49 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:39:49 user nova-compute[70869]:       <nova:owner>
Jul 25 15:39:49 user nova-compute[70869]:         <nova:user uuid="522c108f563c4c18a2054332549bc66a">tempest-VolumesActionsTest-1245951475-project-member</nova:user>
Jul 25 15:39:49 user nova-compute[70869]:         <nova:project uuid="a813ccd5a13f4ec689ef47b069c02448">tempest-VolumesActionsTest-1245951475</nova:project>
Jul 25 15:39:49 user nova-compute[70869]:       </nova:owner>
Jul 25 15:39:49 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:39:49 user nova-compute[70869]:       <nova:ports>
Jul 25 15:39:49 user nova-compute[70869]:         <nova:port uuid="5b396992-40d9-402a-8163-dbf99fb727bf">
Jul 25 15:39:49 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 15:39:49 user nova-compute[70869]:         </nova:port>
Jul 25 15:39:49 user nova-compute[70869]:       </nova:ports>
Jul 25 15:39:49 user nova-compute[70869]:     </nova:instance>
Jul 25 15:39:49 user nova-compute[70869]:   </metadata>
Jul 25 15:39:49 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:39:49 user nova-compute[70869]:     <system>
Jul 25 15:39:49 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:39:49 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:39:49 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:39:49 user nova-compute[70869]:       <entry name="serial">23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9</entry>
Jul 25 15:39:49 user nova-compute[70869]:       <entry name="uuid">23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9</entry>
Jul 25 15:39:49 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:39:49 user nova-compute[70869]:     </system>
Jul 25 15:39:49 user nova-compute[70869]:   </sysinfo>
Jul 25 15:39:49 user nova-compute[70869]:   <os>
Jul 25 15:39:49 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:39:49 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:39:49 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:39:49 user nova-compute[70869]:   </os>
Jul 25 15:39:49 user nova-compute[70869]:   <features>
Jul 25 15:39:49 user nova-compute[70869]:     <acpi/>
Jul 25 15:39:49 user nova-compute[70869]:     <apic/>
Jul 25 15:39:49 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:39:49 user nova-compute[70869]:   </features>
Jul 25 15:39:49 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:39:49 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:39:49 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:39:49 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:39:49 user nova-compute[70869]:   </clock>
Jul 25 15:39:49 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:39:49 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:39:49 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:39:49 user nova-compute[70869]:   </cpu>
Jul 25 15:39:49 user nova-compute[70869]:   <devices>
Jul 25 15:39:49 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:39:49 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:39:49 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk"/>
Jul 25 15:39:49 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:39:49 user nova-compute[70869]:     </disk>
Jul 25 15:39:49 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:39:49 user nova-compute[70869]:       <mac address="fa:16:3e:19:b3:a8"/>
Jul 25 15:39:49 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:39:49 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:39:49 user nova-compute[70869]:       <target dev="tap5b396992-40"/>
Jul 25 15:39:49 user nova-compute[70869]:     </interface>
Jul 25 15:39:49 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:39:49 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/console.log" append="off"/>
Jul 25 15:39:49 user nova-compute[70869]:     </serial>
Jul 25 15:39:49 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:39:49 user nova-compute[70869]:     <video>
Jul 25 15:39:49 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:39:49 user nova-compute[70869]:     </video>
Jul 25 15:39:49 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:39:49 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:39:49 user nova-compute[70869]:     </rng>
Jul 25 15:39:49 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:39:49 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:39:49 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:39:49 user nova-compute[70869]:     </memballoon>
Jul 25 15:39:49 user nova-compute[70869]:   </devices>
Jul 25 15:39:49 user nova-compute[70869]: </domain>
Jul 25 15:39:49 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-762095310',display_name='tempest-VolumesActionsTest-instance-762095310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-762095310',id=22,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813ccd5a13f4ec689ef47b069c02448',ramdisk_id='',reservation_id='r-ev3al2xi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1245951475',owner_user_name='tempest-VolumesActionsTest-1245951475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:39:48Z,user_data=None,user_id='522c108f563c4c18a2054332549bc66a',uuid=23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converting VIF {"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b3:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b396992-40d9-402a-8163-dbf99fb727bf,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b396992-40') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:39:49 user nova-compute[70869]: DEBUG os_vif [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b3:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b396992-40d9-402a-8163-dbf99fb727bf,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b396992-40') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Releasing lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b396992-40, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b396992-40, col_values=(('external_ids', {'iface-id': '5b396992-40d9-402a-8163-dbf99fb727bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:b3:a8', 'vm-uuid': '23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:50 user nova-compute[70869]: INFO os_vif [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b3:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b396992-40d9-402a-8163-dbf99fb727bf,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b396992-40')
Jul 25 15:39:50 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance destroyed successfully.
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'resources' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1782526812',display_name='tempest-AttachVolumeTestJSON-server-1782526812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1782526812',id=17,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgx4fq1cT4MygBGosJgP3XPSWGKF3gnduqEAFmLa+F0YVFSQUPKLO96fGYOHT8HxxGd6r8xcuaJXn2eA+U3LK/s80eGJrh+hSaGuqjT1BrCFhcZworBSoltLMzly4CBDw==',key_name='tempest-keypair-660713528',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-3lkej28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=00d20ec6-9f55-42f9-b4ed-6c02c9ac390f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_vif [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd545db2f-02, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] No VIF found with MAC fa:16:3e:19:b3:a8, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:39:50 user nova-compute[70869]: INFO os_vif [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02')
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwNZofUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:39:50 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[731c7e46-73f5-47de-a3f8-24e9c670eb76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:39:50 user nova-compute[70869]: No targets found.
Jul 25 15:39:50 user nova-compute[70869]: iSNS:
Jul 25 15:39:50 user nova-compute[70869]: No targets found.
Jul 25 15:39:50 user nova-compute[70869]: STATIC:
Jul 25 15:39:50 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16
Jul 25 15:39:50 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:39:50 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:39:50 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:39:50 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:39:50 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:39:50 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:39:50 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:39:50 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:39:50 user nova-compute[70869]: FIRMWARE:
Jul 25 15:39:50 user nova-compute[70869]: No targets found.
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:39:50 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:39:50 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a084fd5d-f97d-4552-a9d5-3bcdf60ea298]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[398b6926-af5b-4502-8bd5-8f60ce28cc47]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4430b11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e681fa-b0fd-4a2c-af9e-114dab2d6c80]: (4, ('path checker states:\nup                  1\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[998d38a2-f495-4bba-bec4-d31cd15f7144]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7db8441-d4e9-4a0f-9596-8bc2093e6204]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cd049b-a8e9-421d-97cf-f1cde501b59e]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49f1fba-cc63-415c-b75c-4ab50d0a7b98]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a260726c-599f-4046-a99f-867999df1550]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260]
Jul 25 15:39:50 user nova-compute[70869]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260] successful.
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ac4729-f435-4ca2-af66-2690522acda4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== disconnect_volume: return (316ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-dc972c44-a812-496c-b597-b1d51d3788a3 req-9cd43796-2ec5-40fc-9f0b-e43eb74d9307 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Updated VIF entry in instance network info cache for port 5b396992-40d9-402a-8163-dbf99fb727bf. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-dc972c44-a812-496c-b597-b1d51d3788a3 req-9cd43796-2ec5-40fc-9f0b-e43eb74d9307 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Updating instance_info_cache with network_info: [{"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Start _get_guest_xml network_info=[{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '07b91561-fc31-40fe-b559-978205c82bab', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwNZofUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '00d20ec6-9f55-42f9-b4ed-6c02c9ac390f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9fae374-9a46-4bb4-a6ea-75b14f062c16', 'serial': 'f9fae374-9a46-4bb4-a6ea-75b14f062c16'}, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'numa_topology' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dc972c44-a812-496c-b597-b1d51d3788a3 req-9cd43796-2ec5-40fc-9f0b-e43eb74d9307 service nova] Releasing lock "refresh_cache-23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:50 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:39:50 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwNZofUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:39:50 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:39:50 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:39:50 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb88417-9613-4068-8f82-3fa7f091371b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:39:50 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba16fc9-a554-4cd7-8062-683acce4408f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16] added
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[79578ae3-e22c-4aea-97b3-f535143c91e4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c6e4c-d45d-4b87-adbc-96529d318acb]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwNZofUA {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwNZofUA" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a059d9-f6c0-483b-b4a4-431bfe6aa9ed]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hwNZofUA'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[96802f1c-b849-4d48-b62d-02c413e24167]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aac4180-1f6d-4fb9-96e4-0d738bf30869]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1d3de-f77a-4cc1-8d4b-8ecdd5086dad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260]
Jul 25 15:39:50 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260] successful.
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f8ca20-3e71-47a2-98ed-d45898e86292]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf545c-144e-429e-8db2-de3fccc90042]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:39:50 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:39:50 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd5b752-79cc-478c-97da-d878919f4d4e]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:50 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwNZofUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23164303339313832', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164303339313832', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1782526812',display_name='tempest-AttachVolumeTestJSON-server-1782526812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1782526812',id=17,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgx4fq1cT4MygBGosJgP3XPSWGKF3gnduqEAFmLa+F0YVFSQUPKLO96fGYOHT8HxxGd6r8xcuaJXn2eA+U3LK/s80eGJrh+hSaGuqjT1BrCFhcZworBSoltLMzly4CBDw==',key_name='tempest-keypair-660713528',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-3lkej28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=00d20ec6-9f55-42f9-b4ed-6c02c9ac390f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'pci_devices' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:39:51 user nova-compute[70869]:   <uuid>00d20ec6-9f55-42f9-b4ed-6c02c9ac390f</uuid>
Jul 25 15:39:51 user nova-compute[70869]:   <name>instance-00000011</name>
Jul 25 15:39:51 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:39:51 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:39:51 user nova-compute[70869]:   <metadata>
Jul 25 15:39:51 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:39:51 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:39:51 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeTestJSON-server-1782526812</nova:name>
Jul 25 15:39:51 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:39:50</nova:creationTime>
Jul 25 15:39:51 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:39:51 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:39:51 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:39:51 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:39:51 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:39:51 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:39:51 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:39:51 user nova-compute[70869]:       <nova:owner>
Jul 25 15:39:51 user nova-compute[70869]:         <nova:user uuid="3d528e01a08f40d4b598ab8222c2edf5">tempest-AttachVolumeTestJSON-512738646-project-member</nova:user>
Jul 25 15:39:51 user nova-compute[70869]:         <nova:project uuid="d2f5d520a39742c69302f96795d0ea61">tempest-AttachVolumeTestJSON-512738646</nova:project>
Jul 25 15:39:51 user nova-compute[70869]:       </nova:owner>
Jul 25 15:39:51 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:39:51 user nova-compute[70869]:       <nova:ports>
Jul 25 15:39:51 user nova-compute[70869]:         <nova:port uuid="d545db2f-0230-400f-9bcd-e3db63ade6b6">
Jul 25 15:39:51 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 15:39:51 user nova-compute[70869]:         </nova:port>
Jul 25 15:39:51 user nova-compute[70869]:       </nova:ports>
Jul 25 15:39:51 user nova-compute[70869]:     </nova:instance>
Jul 25 15:39:51 user nova-compute[70869]:   </metadata>
Jul 25 15:39:51 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:39:51 user nova-compute[70869]:     <system>
Jul 25 15:39:51 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:39:51 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:39:51 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:39:51 user nova-compute[70869]:       <entry name="serial">00d20ec6-9f55-42f9-b4ed-6c02c9ac390f</entry>
Jul 25 15:39:51 user nova-compute[70869]:       <entry name="uuid">00d20ec6-9f55-42f9-b4ed-6c02c9ac390f</entry>
Jul 25 15:39:51 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:39:51 user nova-compute[70869]:     </system>
Jul 25 15:39:51 user nova-compute[70869]:   </sysinfo>
Jul 25 15:39:51 user nova-compute[70869]:   <os>
Jul 25 15:39:51 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:39:51 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:39:51 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:39:51 user nova-compute[70869]:   </os>
Jul 25 15:39:51 user nova-compute[70869]:   <features>
Jul 25 15:39:51 user nova-compute[70869]:     <acpi/>
Jul 25 15:39:51 user nova-compute[70869]:     <apic/>
Jul 25 15:39:51 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:39:51 user nova-compute[70869]:   </features>
Jul 25 15:39:51 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:39:51 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:39:51 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:39:51 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:39:51 user nova-compute[70869]:   </clock>
Jul 25 15:39:51 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:39:51 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:39:51 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:39:51 user nova-compute[70869]:   </cpu>
Jul 25 15:39:51 user nova-compute[70869]:   <devices>
Jul 25 15:39:51 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:39:51 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:39:51 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk"/>
Jul 25 15:39:51 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:39:51 user nova-compute[70869]:     </disk>
Jul 25 15:39:51 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:39:51 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:39:51 user nova-compute[70869]:       <source dev="/dev/sdc"/>
Jul 25 15:39:51 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:39:51 user nova-compute[70869]:       <serial>f9fae374-9a46-4bb4-a6ea-75b14f062c16</serial>
Jul 25 15:39:51 user nova-compute[70869]:     </disk>
Jul 25 15:39:51 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:39:51 user nova-compute[70869]:       <mac address="fa:16:3e:de:f6:f9"/>
Jul 25 15:39:51 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:39:51 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:39:51 user nova-compute[70869]:       <target dev="tapd545db2f-02"/>
Jul 25 15:39:51 user nova-compute[70869]:     </interface>
Jul 25 15:39:51 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:39:51 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/console.log" append="off"/>
Jul 25 15:39:51 user nova-compute[70869]:     </serial>
Jul 25 15:39:51 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:39:51 user nova-compute[70869]:     <video>
Jul 25 15:39:51 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:39:51 user nova-compute[70869]:     </video>
Jul 25 15:39:51 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:39:51 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:39:51 user nova-compute[70869]:     </rng>
Jul 25 15:39:51 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:39:51 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:39:51 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:39:51 user nova-compute[70869]:     </memballoon>
Jul 25 15:39:51 user nova-compute[70869]:   </devices>
Jul 25 15:39:51 user nova-compute[70869]: </domain>
Jul 25 15:39:51 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:39:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-d927a6e1-4f1e-41eb-9899-9f6aeaf9dc6a req-5b57bf2e-9ef7-4e28-9aa6-9459f8ec9828 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d927a6e1-4f1e-41eb-9899-9f6aeaf9dc6a req-5b57bf2e-9ef7-4e28-9aa6-9459f8ec9828 service nova] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d927a6e1-4f1e-41eb-9899-9f6aeaf9dc6a req-5b57bf2e-9ef7-4e28-9aa6-9459f8ec9828 service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d927a6e1-4f1e-41eb-9899-9f6aeaf9dc6a req-5b57bf2e-9ef7-4e28-9aa6-9459f8ec9828 service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-d927a6e1-4f1e-41eb-9899-9f6aeaf9dc6a req-5b57bf2e-9ef7-4e28-9aa6-9459f8ec9828 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] No waiting events found dispatching network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:52 user nova-compute[70869]: WARNING nova.compute.manager [req-d927a6e1-4f1e-41eb-9899-9f6aeaf9dc6a req-5b57bf2e-9ef7-4e28-9aa6-9459f8ec9828 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received unexpected event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf for instance with vm_state building and task_state spawning.
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Cannot resize image /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'migration_context' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1782526812',display_name='tempest-AttachVolumeTestJSON-server-1782526812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1782526812',id=17,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgx4fq1cT4MygBGosJgP3XPSWGKF3gnduqEAFmLa+F0YVFSQUPKLO96fGYOHT8HxxGd6r8xcuaJXn2eA+U3LK/s80eGJrh+hSaGuqjT1BrCFhcZworBSoltLMzly4CBDw==',key_name='tempest-keypair-660713528',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-3lkej28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=00d20ec6-9f55-42f9-b4ed-6c02c9ac390f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG os_vif [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd545db2f-02, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd545db2f-02, col_values=(('external_ids', {'iface-id': 'd545db2f-0230-400f-9bcd-e3db63ade6b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:f6:f9', 'vm-uuid': '00d20ec6-9f55-42f9-b4ed-6c02c9ac390f'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:39:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:52 user nova-compute[70869]: INFO os_vif [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02')
Jul 25 15:39:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299593.864144, 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:39:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] VM Resumed (Lifecycle Event)
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:39:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Instance spawned successfully.
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:39:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299593.8689032, 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:39:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] VM Started (Lifecycle Event)
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:53 user nova-compute[70869]: INFO nova.compute.manager [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Shelve offloading
Jul 25 15:39:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:39:54 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:39:54 user nova-compute[70869]: INFO nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Took 6.27 seconds to spawn the instance on the hypervisor.
Jul 25 15:39:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] No waiting events found dispatching network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:54 user nova-compute[70869]: WARNING nova.compute.manager [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received unexpected event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf for instance with vm_state building and task_state spawning.
Jul 25 15:39:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-changed-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing instance network info cache due to event network-changed-685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] Acquiring lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] Acquired lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG nova.network.neutron [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:54 user nova-compute[70869]: INFO nova.compute.manager [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Took 7.09 seconds to build instance.
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0e8a2d31-5646-4ab1-a805-dd6e2963dab0 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.244s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d5c2247-4c81-4bfe-90a2-360dcc35ce55 req-d4735ce3-9f6a-430d-a5f2-08a4fecd2bd8 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-unplugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d5c2247-4c81-4bfe-90a2-360dcc35ce55 req-d4735ce3-9f6a-430d-a5f2-08a4fecd2bd8 service nova] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d5c2247-4c81-4bfe-90a2-360dcc35ce55 req-d4735ce3-9f6a-430d-a5f2-08a4fecd2bd8 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d5c2247-4c81-4bfe-90a2-360dcc35ce55 req-d4735ce3-9f6a-430d-a5f2-08a4fecd2bd8 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d5c2247-4c81-4bfe-90a2-360dcc35ce55 req-d4735ce3-9f6a-430d-a5f2-08a4fecd2bd8 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] No waiting events found dispatching network-vif-unplugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:54 user nova-compute[70869]: WARNING nova.compute.manager [req-9d5c2247-4c81-4bfe-90a2-360dcc35ce55 req-d4735ce3-9f6a-430d-a5f2-08a4fecd2bd8 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received unexpected event network-vif-unplugged-685fa69b-6fa0-4620-8367-c7363215995c for instance with vm_state active and task_state shelving.
Jul 25 15:39:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:54 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Instance destroyed successfully.
Jul 25 15:39:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:55 user nova-compute[70869]: DEBUG nova.network.neutron [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updated VIF entry in instance network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:39:55 user nova-compute[70869]: DEBUG nova.network.neutron [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating instance_info_cache with network_info: [{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-29a45f10-ffaf-4ece-a5fc-571fa19eb891 req-1d36a2ed-45e7-4847-b436-67bbb4b74ed0 service nova] Releasing lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquired lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] No waiting events found dispatching network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:56 user nova-compute[70869]: WARNING nova.compute.manager [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received unexpected event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c for instance with vm_state active and task_state shelving.
Jul 25 15:39:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:56 user nova-compute[70869]: WARNING nova.compute.manager [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state stopped and task_state powering-on.
Jul 25 15:39:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:39:56 user nova-compute[70869]: WARNING nova.compute.manager [req-0f264ed0-1191-4412-a0fa-06c5efb5549a req-c53c2bcd-8b8d-42ff-9ddb-9d200920c0d4 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state stopped and task_state powering-on.
Jul 25 15:39:56 user nova-compute[70869]: DEBUG nova.network.neutron [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating instance_info_cache with network_info: [{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Releasing lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299597.062974, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:39:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] VM Resumed (Lifecycle Event)
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:39:57 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance rebooted successfully.
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7f55add7-e5cf-46df-9bb8-f3100ca11f56 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:39:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299597.0645957, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:39:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] VM Started (Lifecycle Event)
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:57 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Instance destroyed successfully.
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.objects.instance [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lazy-loading 'resources' on Instance uuid 4d9706b8-2a69-4272-89d3-f8a985e0ad2c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1120590963',display_name='tempest-TestShelveInstance-server-1120590963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1120590963',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIgLtUd6WGXmr6U7WthLqyhjTgPJ8c1kY/GE2MVvAA0fdKsiMoEQPcMEldthR7JieY77CD1/uKZkLQ4DWjjCVjLUomINTCZvIG2NVvpOQd+8k106ZkJRPzkRSKmT72jPg==',key_name='tempest-TestShelveInstance-1341964134',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:38:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77781f71b0364014b1561b8158656565',ramdisk_id='',reservation_id='r-ax0saf22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2115421608',owner_user_name='tempest-TestShelveInstance-2115421608-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:38:17Z,user_data=None,user_id='6af1342ac93849d995a457cde23bde41',uuid=4d9706b8-2a69-4272-89d3-f8a985e0ad2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converting VIF {"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_vif [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap685fa69b-6f, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:57 user nova-compute[70869]: INFO os_vif [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f')
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNljCLFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:39:57 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf4b0db-c688-4668-911a-d05866c9ac04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:39:57 user nova-compute[70869]: No targets found.
Jul 25 15:39:57 user nova-compute[70869]: iSNS:
Jul 25 15:39:57 user nova-compute[70869]: No targets found.
Jul 25 15:39:57 user nova-compute[70869]: STATIC:
Jul 25 15:39:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16
Jul 25 15:39:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:39:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:39:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:39:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:39:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:39:57 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:39:57 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:39:57 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:39:57 user nova-compute[70869]: FIRMWARE:
Jul 25 15:39:57 user nova-compute[70869]: No targets found.
Jul 25 15:39:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:39:57 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:39:57 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-526c5f15-2998-4913-bc3f-9d13cb4ab9b3 req-f3677db5-2550-4033-9d3b-4b292a37fe81 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-changed-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-526c5f15-2998-4913-bc3f-9d13cb4ab9b3 req-f3677db5-2550-4033-9d3b-4b292a37fe81 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing instance network info cache due to event network-changed-685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-526c5f15-2998-4913-bc3f-9d13cb4ab9b3 req-f3677db5-2550-4033-9d3b-4b292a37fe81 service nova] Acquiring lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-526c5f15-2998-4913-bc3f-9d13cb4ab9b3 req-f3677db5-2550-4033-9d3b-4b292a37fe81 service nova] Acquired lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.network.neutron [req-526c5f15-2998-4913-bc3f-9d13cb4ab9b3 req-f3677db5-2550-4033-9d3b-4b292a37fe81 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315eb10-11c6-4f6d-aa1f-619686b1abbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bbff4d-c61f-45af-b80a-bfd9b13a45c1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:39:57 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:39:57 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:39:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:39:57 user nova-compute[70869]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:39:57 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:39:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c050310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a'): ({'sdf'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Removing single pathed devices sdf {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ea7c8d-58e3-4828-9370-a5718ec8c3dd]: (4, ('path checker states:\nup                  1\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30bb9ee-053a-46a6-b1ef-a6a36eb29757]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Flushing IO for device /dev/sdf {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a71a1c-293b-4b7f-9655-d62c3029e1b3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1795af9-274a-4a3f-a2db-da1d5e0346e5]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] SCSI volumes sdf have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff3485b-35c0-4b61-81c4-4efd8d02161e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c127e7-2acf-46e5-8b6e-8e180b976055]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260]
Jul 25 15:39:57 user nova-compute[70869]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260] successful.
Jul 25 15:39:57 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9f246b-476a-4a70-8f53-63a3e05d70fb]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] <== disconnect_volume: return (366ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:39:57 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Deleting instance files /opt/stack/data/nova/instances/4d9706b8-2a69-4272-89d3-f8a985e0ad2c_del
Jul 25 15:39:57 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Deletion of /opt/stack/data/nova/instances/4d9706b8-2a69-4272-89d3-f8a985e0ad2c_del complete
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299582.9756722, fa170559-5228-448f-acea-c5b816a22631 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:39:57 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: fa170559-5228-448f-acea-c5b816a22631] VM Stopped (Lifecycle Event)
Jul 25 15:39:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-01d0f613-cfd0-40d8-8b96-1c14053c01fe None None] [instance: fa170559-5228-448f-acea-c5b816a22631] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:39:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-526c5f15-2998-4913-bc3f-9d13cb4ab9b3 req-f3677db5-2550-4033-9d3b-4b292a37fe81 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updated VIF entry in instance network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:39:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-526c5f15-2998-4913-bc3f-9d13cb4ab9b3 req-f3677db5-2550-4033-9d3b-4b292a37fe81 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating instance_info_cache with network_info: [{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": null, "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap685fa69b-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:39:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-526c5f15-2998-4913-bc3f-9d13cb4ab9b3 req-f3677db5-2550-4033-9d3b-4b292a37fe81 service nova] Releasing lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:39:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:39:58 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Deleted allocations for instance 4d9706b8-2a69-4272-89d3-f8a985e0ad2c
Jul 25 15:39:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:39:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:39:59 user nova-compute[70869]: DEBUG nova.objects.instance [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d9706b8-2a69-4272-89d3-f8a985e0ad2c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:39:59 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:39:59 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:39:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:39:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-032093d8-2491-4d52-9316-73b51fb5a293 tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.548s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:09 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299594.889386, 4d9706b8-2a69-4272-89d3-f8a985e0ad2c => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:40:09 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] VM Stopped (Lifecycle Event)
Jul 25 15:40:09 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e8761fb-efca-419c-abde-e96b7054a0b6 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "18fc35fb-1ce7-4744-9189-1d80ede0a230" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:40:18 user nova-compute[70869]: INFO nova.compute.claims [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Claim successful on node user
Jul 25 15:40:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:40:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:40:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Creating image(s)
Jul 25 15:40:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "/opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "/opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "/opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG nova.policy [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02dfa618b8fc4b06b5e396b7da9e8443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3735c3192f424a8abee7c1874609f005', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.163s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk 1073741824" returned: 0 in 0.068s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.190s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Cannot resize image /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG nova.objects.instance [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'migration_context' on Instance uuid 18fc35fb-1ce7-4744-9189-1d80ede0a230 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Ensure instance console log exists: /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Successfully created port: f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Successfully updated port: f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "refresh_cache-18fc35fb-1ce7-4744-9189-1d80ede0a230" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquired lock "refresh_cache-18fc35fb-1ce7-4744-9189-1d80ede0a230" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.compute.manager [req-e670cbbc-d1eb-40e3-b2de-1efd03b2a611 req-27d80f89-f0bb-49cd-9527-098fab3ef4f8 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received event network-changed-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.compute.manager [req-e670cbbc-d1eb-40e3-b2de-1efd03b2a611 req-27d80f89-f0bb-49cd-9527-098fab3ef4f8 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Refreshing instance network info cache due to event network-changed-f7dcd88f-e941-4e13-8e75-ff571f37837e. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e670cbbc-d1eb-40e3-b2de-1efd03b2a611 req-27d80f89-f0bb-49cd-9527-098fab3ef4f8 service nova] Acquiring lock "refresh_cache-18fc35fb-1ce7-4744-9189-1d80ede0a230" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Updating instance_info_cache with network_info: [{"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Releasing lock "refresh_cache-18fc35fb-1ce7-4744-9189-1d80ede0a230" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Instance network_info: |[{"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e670cbbc-d1eb-40e3-b2de-1efd03b2a611 req-27d80f89-f0bb-49cd-9527-098fab3ef4f8 service nova] Acquired lock "refresh_cache-18fc35fb-1ce7-4744-9189-1d80ede0a230" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-e670cbbc-d1eb-40e3-b2de-1efd03b2a611 req-27d80f89-f0bb-49cd-9527-098fab3ef4f8 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Refreshing network info cache for port f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Start _get_guest_xml network_info=[{"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:40:21 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:40:21 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-585867573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-585867573',id=23,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-dcyhpzen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:40:19Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=18fc35fb-1ce7-4744-9189-1d80ede0a230,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:91:95,bridge_name='br-int',has_traffic_filtering=True,id=f7dcd88f-e941-4e13-8e75-ff571f37837e,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dcd88f-e9') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.objects.instance [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'pci_devices' on Instance uuid 18fc35fb-1ce7-4744-9189-1d80ede0a230 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:40:21 user nova-compute[70869]:   <uuid>18fc35fb-1ce7-4744-9189-1d80ede0a230</uuid>
Jul 25 15:40:21 user nova-compute[70869]:   <name>instance-00000017</name>
Jul 25 15:40:21 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:40:21 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:40:21 user nova-compute[70869]:   <metadata>
Jul 25 15:40:21 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:40:21 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:40:21 user nova-compute[70869]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-585867573</nova:name>
Jul 25 15:40:21 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:40:21</nova:creationTime>
Jul 25 15:40:21 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:40:21 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:40:21 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:40:21 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:40:21 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:40:21 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:40:21 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:40:21 user nova-compute[70869]:       <nova:owner>
Jul 25 15:40:21 user nova-compute[70869]:         <nova:user uuid="02dfa618b8fc4b06b5e396b7da9e8443">tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member</nova:user>
Jul 25 15:40:21 user nova-compute[70869]:         <nova:project uuid="3735c3192f424a8abee7c1874609f005">tempest-ServerBootFromVolumeStableRescueTest-508290498</nova:project>
Jul 25 15:40:21 user nova-compute[70869]:       </nova:owner>
Jul 25 15:40:21 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:40:21 user nova-compute[70869]:       <nova:ports>
Jul 25 15:40:21 user nova-compute[70869]:         <nova:port uuid="f7dcd88f-e941-4e13-8e75-ff571f37837e">
Jul 25 15:40:21 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 15:40:21 user nova-compute[70869]:         </nova:port>
Jul 25 15:40:21 user nova-compute[70869]:       </nova:ports>
Jul 25 15:40:21 user nova-compute[70869]:     </nova:instance>
Jul 25 15:40:21 user nova-compute[70869]:   </metadata>
Jul 25 15:40:21 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:40:21 user nova-compute[70869]:     <system>
Jul 25 15:40:21 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:40:21 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:40:21 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:40:21 user nova-compute[70869]:       <entry name="serial">18fc35fb-1ce7-4744-9189-1d80ede0a230</entry>
Jul 25 15:40:21 user nova-compute[70869]:       <entry name="uuid">18fc35fb-1ce7-4744-9189-1d80ede0a230</entry>
Jul 25 15:40:21 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:40:21 user nova-compute[70869]:     </system>
Jul 25 15:40:21 user nova-compute[70869]:   </sysinfo>
Jul 25 15:40:21 user nova-compute[70869]:   <os>
Jul 25 15:40:21 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:40:21 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:40:21 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:40:21 user nova-compute[70869]:   </os>
Jul 25 15:40:21 user nova-compute[70869]:   <features>
Jul 25 15:40:21 user nova-compute[70869]:     <acpi/>
Jul 25 15:40:21 user nova-compute[70869]:     <apic/>
Jul 25 15:40:21 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:40:21 user nova-compute[70869]:   </features>
Jul 25 15:40:21 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:40:21 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:40:21 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:40:21 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:40:21 user nova-compute[70869]:   </clock>
Jul 25 15:40:21 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:40:21 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:40:21 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:40:21 user nova-compute[70869]:   </cpu>
Jul 25 15:40:21 user nova-compute[70869]:   <devices>
Jul 25 15:40:21 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:40:21 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:40:21 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk"/>
Jul 25 15:40:21 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:40:21 user nova-compute[70869]:     </disk>
Jul 25 15:40:21 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:40:21 user nova-compute[70869]:       <mac address="fa:16:3e:b6:91:95"/>
Jul 25 15:40:21 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:40:21 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:40:21 user nova-compute[70869]:       <target dev="tapf7dcd88f-e9"/>
Jul 25 15:40:21 user nova-compute[70869]:     </interface>
Jul 25 15:40:21 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:40:21 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/console.log" append="off"/>
Jul 25 15:40:21 user nova-compute[70869]:     </serial>
Jul 25 15:40:21 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:40:21 user nova-compute[70869]:     <video>
Jul 25 15:40:21 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:40:21 user nova-compute[70869]:     </video>
Jul 25 15:40:21 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:40:21 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:40:21 user nova-compute[70869]:     </rng>
Jul 25 15:40:21 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:40:21 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:40:21 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:40:21 user nova-compute[70869]:     </memballoon>
Jul 25 15:40:21 user nova-compute[70869]:   </devices>
Jul 25 15:40:21 user nova-compute[70869]: </domain>
Jul 25 15:40:21 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-585867573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-585867573',id=23,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-dcyhpzen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:40:19Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=18fc35fb-1ce7-4744-9189-1d80ede0a230,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:91:95,bridge_name='br-int',has_traffic_filtering=True,id=f7dcd88f-e941-4e13-8e75-ff571f37837e,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dcd88f-e9') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG os_vif [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:91:95,bridge_name='br-int',has_traffic_filtering=True,id=f7dcd88f-e941-4e13-8e75-ff571f37837e,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dcd88f-e9') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7dcd88f-e9, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7dcd88f-e9, col_values=(('external_ids', {'iface-id': 'f7dcd88f-e941-4e13-8e75-ff571f37837e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:91:95', 'vm-uuid': '18fc35fb-1ce7-4744-9189-1d80ede0a230'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:21 user nova-compute[70869]: INFO os_vif [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:91:95,bridge_name='br-int',has_traffic_filtering=True,id=f7dcd88f-e941-4e13-8e75-ff571f37837e,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dcd88f-e9')
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No VIF found with MAC fa:16:3e:b6:91:95, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-e670cbbc-d1eb-40e3-b2de-1efd03b2a611 req-27d80f89-f0bb-49cd-9527-098fab3ef4f8 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Updated VIF entry in instance network info cache for port f7dcd88f-e941-4e13-8e75-ff571f37837e. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-e670cbbc-d1eb-40e3-b2de-1efd03b2a611 req-27d80f89-f0bb-49cd-9527-098fab3ef4f8 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Updating instance_info_cache with network_info: [{"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:40:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e670cbbc-d1eb-40e3-b2de-1efd03b2a611 req-27d80f89-f0bb-49cd-9527-098fab3ef4f8 service nova] Releasing lock "refresh_cache-18fc35fb-1ce7-4744-9189-1d80ede0a230" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:40:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-4909534f-b2f2-4132-b2f0-f9080e033fdf req-2c168e73-9b36-49c0-9ecc-4a59f343c1dc service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received event network-vif-plugged-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4909534f-b2f2-4132-b2f0-f9080e033fdf req-2c168e73-9b36-49c0-9ecc-4a59f343c1dc service nova] Acquiring lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4909534f-b2f2-4132-b2f0-f9080e033fdf req-2c168e73-9b36-49c0-9ecc-4a59f343c1dc service nova] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4909534f-b2f2-4132-b2f0-f9080e033fdf req-2c168e73-9b36-49c0-9ecc-4a59f343c1dc service nova] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-4909534f-b2f2-4132-b2f0-f9080e033fdf req-2c168e73-9b36-49c0-9ecc-4a59f343c1dc service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] No waiting events found dispatching network-vif-plugged-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:40:23 user nova-compute[70869]: WARNING nova.compute.manager [req-4909534f-b2f2-4132-b2f0-f9080e033fdf req-2c168e73-9b36-49c0-9ecc-4a59f343c1dc service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received unexpected event network-vif-plugged-f7dcd88f-e941-4e13-8e75-ff571f37837e for instance with vm_state building and task_state spawning.
Jul 25 15:40:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-f05b30a2-f4b2-4108-b26b-ccdb090be53b req-da8d2fd5-cacd-444b-b778-3dee531a9adf service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received event network-vif-plugged-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f05b30a2-f4b2-4108-b26b-ccdb090be53b req-da8d2fd5-cacd-444b-b778-3dee531a9adf service nova] Acquiring lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f05b30a2-f4b2-4108-b26b-ccdb090be53b req-da8d2fd5-cacd-444b-b778-3dee531a9adf service nova] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f05b30a2-f4b2-4108-b26b-ccdb090be53b req-da8d2fd5-cacd-444b-b778-3dee531a9adf service nova] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-f05b30a2-f4b2-4108-b26b-ccdb090be53b req-da8d2fd5-cacd-444b-b778-3dee531a9adf service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] No waiting events found dispatching network-vif-plugged-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:40:25 user nova-compute[70869]: WARNING nova.compute.manager [req-f05b30a2-f4b2-4108-b26b-ccdb090be53b req-da8d2fd5-cacd-444b-b778-3dee531a9adf service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received unexpected event network-vif-plugged-f7dcd88f-e941-4e13-8e75-ff571f37837e for instance with vm_state building and task_state spawning.
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299625.3773417, 18fc35fb-1ce7-4744-9189-1d80ede0a230 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:40:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] VM Resumed (Lifecycle Event)
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:40:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Instance spawned successfully.
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299625.3777695, 18fc35fb-1ce7-4744-9189-1d80ede0a230 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:40:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] VM Started (Lifecycle Event)
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:40:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:40:25 user nova-compute[70869]: INFO nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Took 6.54 seconds to spawn the instance on the hypervisor.
Jul 25 15:40:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:25 user nova-compute[70869]: INFO nova.compute.manager [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Took 7.49 seconds to build instance.
Jul 25 15:40:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66386930-1601-497e-994b-bc099379d3c4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.617s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:40:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:31 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:40:31 user nova-compute[70869]: INFO nova.compute.claims [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Claim successful on node user
Jul 25 15:40:32 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:40:32 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:40:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG nova.policy [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5d92c004234431fbeb875c789149c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8586c0f069de4002b5d51cb402692ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:40:32 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Creating image(s)
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "/opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "/opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.178s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk 1073741824" returned: 0 in 0.056s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Cannot resize image /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lazy-loading 'migration_context' on Instance uuid bb780430-2cb6-4443-98ed-a224ec35bf57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Ensure instance console log exists: /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Successfully created port: 3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:40:33 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Successfully updated port: 3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "refresh_cache-bb780430-2cb6-4443-98ed-a224ec35bf57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquired lock "refresh_cache-bb780430-2cb6-4443-98ed-a224ec35bf57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-cea08ad9-953a-43e4-bc41-c0a77e6bd2bb req-2a6b0d00-4e17-42c5-93b7-b8c0311a2ac6 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received event network-changed-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-cea08ad9-953a-43e4-bc41-c0a77e6bd2bb req-2a6b0d00-4e17-42c5-93b7-b8c0311a2ac6 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Refreshing instance network info cache due to event network-changed-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cea08ad9-953a-43e4-bc41-c0a77e6bd2bb req-2a6b0d00-4e17-42c5-93b7-b8c0311a2ac6 service nova] Acquiring lock "refresh_cache-bb780430-2cb6-4443-98ed-a224ec35bf57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updating instance_info_cache with network_info: [{"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:40:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Updating instance_info_cache with network_info: [{"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Releasing lock "refresh_cache-bb780430-2cb6-4443-98ed-a224ec35bf57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Instance network_info: |[{"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cea08ad9-953a-43e4-bc41-c0a77e6bd2bb req-2a6b0d00-4e17-42c5-93b7-b8c0311a2ac6 service nova] Acquired lock "refresh_cache-bb780430-2cb6-4443-98ed-a224ec35bf57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.network.neutron [req-cea08ad9-953a-43e4-bc41-c0a77e6bd2bb req-2a6b0d00-4e17-42c5-93b7-b8c0311a2ac6 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Refreshing network info cache for port 3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Start _get_guest_xml network_info=[{"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:40:35 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:40:35 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-488941019',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-488941019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4889410',id=24,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5d8ZdlciBeyMe6OqXEga3f3YZAnht5P0bMIBMe94uZfthXsjOIv4c08c5TYTP9Zv97glL3vNhINKZ9W4QjTBCxNBnCPos/wPh07y2upQLGhpPU5ZhLmxwWyTIz9fZfxA==',key_name='tempest-keypair-1542122477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8586c0f069de4002b5d51cb402692ed2',ramdisk_id='',reservation_id='r-himxzeoc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-643770885',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5d92c004234431fbeb875c789149c02',uuid=bb780430-2cb6-4443-98ed-a224ec35bf57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Converting VIF {"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b5:bd,bridge_name='br-int',has_traffic_filtering=True,id=3bb2f13a-02b4-4872-8b2c-dfb23be94ba1,network=Network(9914bb6f-e17c-4505-93bf-dbb3b7f55e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb2f13a-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lazy-loading 'pci_devices' on Instance uuid bb780430-2cb6-4443-98ed-a224ec35bf57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:40:35 user nova-compute[70869]:   <uuid>bb780430-2cb6-4443-98ed-a224ec35bf57</uuid>
Jul 25 15:40:35 user nova-compute[70869]:   <name>instance-00000018</name>
Jul 25 15:40:35 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:40:35 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:40:35 user nova-compute[70869]:   <metadata>
Jul 25 15:40:35 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:40:35 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:40:35 user nova-compute[70869]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-488941019</nova:name>
Jul 25 15:40:35 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:40:35</nova:creationTime>
Jul 25 15:40:35 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:40:35 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:40:35 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:40:35 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:40:35 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:40:35 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:40:35 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:40:35 user nova-compute[70869]:       <nova:owner>
Jul 25 15:40:35 user nova-compute[70869]:         <nova:user uuid="b5d92c004234431fbeb875c789149c02">tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member</nova:user>
Jul 25 15:40:35 user nova-compute[70869]:         <nova:project uuid="8586c0f069de4002b5d51cb402692ed2">tempest-TestServerVolumeAttachScenarioOldVersion-643770885</nova:project>
Jul 25 15:40:35 user nova-compute[70869]:       </nova:owner>
Jul 25 15:40:35 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:40:35 user nova-compute[70869]:       <nova:ports>
Jul 25 15:40:35 user nova-compute[70869]:         <nova:port uuid="3bb2f13a-02b4-4872-8b2c-dfb23be94ba1">
Jul 25 15:40:35 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 15:40:35 user nova-compute[70869]:         </nova:port>
Jul 25 15:40:35 user nova-compute[70869]:       </nova:ports>
Jul 25 15:40:35 user nova-compute[70869]:     </nova:instance>
Jul 25 15:40:35 user nova-compute[70869]:   </metadata>
Jul 25 15:40:35 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:40:35 user nova-compute[70869]:     <system>
Jul 25 15:40:35 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:40:35 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:40:35 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:40:35 user nova-compute[70869]:       <entry name="serial">bb780430-2cb6-4443-98ed-a224ec35bf57</entry>
Jul 25 15:40:35 user nova-compute[70869]:       <entry name="uuid">bb780430-2cb6-4443-98ed-a224ec35bf57</entry>
Jul 25 15:40:35 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:40:35 user nova-compute[70869]:     </system>
Jul 25 15:40:35 user nova-compute[70869]:   </sysinfo>
Jul 25 15:40:35 user nova-compute[70869]:   <os>
Jul 25 15:40:35 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:40:35 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:40:35 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:40:35 user nova-compute[70869]:   </os>
Jul 25 15:40:35 user nova-compute[70869]:   <features>
Jul 25 15:40:35 user nova-compute[70869]:     <acpi/>
Jul 25 15:40:35 user nova-compute[70869]:     <apic/>
Jul 25 15:40:35 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:40:35 user nova-compute[70869]:   </features>
Jul 25 15:40:35 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:40:35 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:40:35 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:40:35 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:40:35 user nova-compute[70869]:   </clock>
Jul 25 15:40:35 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:40:35 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:40:35 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:40:35 user nova-compute[70869]:   </cpu>
Jul 25 15:40:35 user nova-compute[70869]:   <devices>
Jul 25 15:40:35 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:40:35 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:40:35 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk"/>
Jul 25 15:40:35 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:40:35 user nova-compute[70869]:     </disk>
Jul 25 15:40:35 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:40:35 user nova-compute[70869]:       <mac address="fa:16:3e:4d:b5:bd"/>
Jul 25 15:40:35 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:40:35 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:40:35 user nova-compute[70869]:       <target dev="tap3bb2f13a-02"/>
Jul 25 15:40:35 user nova-compute[70869]:     </interface>
Jul 25 15:40:35 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:40:35 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/console.log" append="off"/>
Jul 25 15:40:35 user nova-compute[70869]:     </serial>
Jul 25 15:40:35 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:40:35 user nova-compute[70869]:     <video>
Jul 25 15:40:35 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:40:35 user nova-compute[70869]:     </video>
Jul 25 15:40:35 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:40:35 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:40:35 user nova-compute[70869]:     </rng>
Jul 25 15:40:35 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:40:35 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:40:35 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:40:35 user nova-compute[70869]:     </memballoon>
Jul 25 15:40:35 user nova-compute[70869]:   </devices>
Jul 25 15:40:35 user nova-compute[70869]: </domain>
Jul 25 15:40:35 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-488941019',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-488941019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4889410',id=24,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5d8ZdlciBeyMe6OqXEga3f3YZAnht5P0bMIBMe94uZfthXsjOIv4c08c5TYTP9Zv97glL3vNhINKZ9W4QjTBCxNBnCPos/wPh07y2upQLGhpPU5ZhLmxwWyTIz9fZfxA==',key_name='tempest-keypair-1542122477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8586c0f069de4002b5d51cb402692ed2',ramdisk_id='',reservation_id='r-himxzeoc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-643770885',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5d92c004234431fbeb875c789149c02',uuid=bb780430-2cb6-4443-98ed-a224ec35bf57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Converting VIF {"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b5:bd,bridge_name='br-int',has_traffic_filtering=True,id=3bb2f13a-02b4-4872-8b2c-dfb23be94ba1,network=Network(9914bb6f-e17c-4505-93bf-dbb3b7f55e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb2f13a-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG os_vif [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b5:bd,bridge_name='br-int',has_traffic_filtering=True,id=3bb2f13a-02b4-4872-8b2c-dfb23be94ba1,network=Network(9914bb6f-e17c-4505-93bf-dbb3b7f55e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb2f13a-02') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bb2f13a-02, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bb2f13a-02, col_values=(('external_ids', {'iface-id': '3bb2f13a-02b4-4872-8b2c-dfb23be94ba1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:b5:bd', 'vm-uuid': 'bb780430-2cb6-4443-98ed-a224ec35bf57'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:35 user nova-compute[70869]: INFO os_vif [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b5:bd,bridge_name='br-int',has_traffic_filtering=True,id=3bb2f13a-02b4-4872-8b2c-dfb23be94ba1,network=Network(9914bb6f-e17c-4505-93bf-dbb3b7f55e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb2f13a-02')
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "8beb6a74-a413-4a75-b8ce-678447cff1a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:35 user nova-compute[70869]: INFO nova.compute.manager [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Terminating instance
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] No VIF found with MAC fa:16:3e:4d:b5:bd, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-98f76af7-a0da-4d9c-a8a8-cae00c6bd5d6 req-9f705f04-2c8d-431a-8ce3-ddc8f3907877 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received event network-vif-unplugged-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-98f76af7-a0da-4d9c-a8a8-cae00c6bd5d6 req-9f705f04-2c8d-431a-8ce3-ddc8f3907877 service nova] Acquiring lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-98f76af7-a0da-4d9c-a8a8-cae00c6bd5d6 req-9f705f04-2c8d-431a-8ce3-ddc8f3907877 service nova] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-98f76af7-a0da-4d9c-a8a8-cae00c6bd5d6 req-9f705f04-2c8d-431a-8ce3-ddc8f3907877 service nova] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-98f76af7-a0da-4d9c-a8a8-cae00c6bd5d6 req-9f705f04-2c8d-431a-8ce3-ddc8f3907877 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] No waiting events found dispatching network-vif-unplugged-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-98f76af7-a0da-4d9c-a8a8-cae00c6bd5d6 req-9f705f04-2c8d-431a-8ce3-ddc8f3907877 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received event network-vif-unplugged-8a556969-3c2f-410a-ac20-29e261e06c2a for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG nova.network.neutron [req-cea08ad9-953a-43e4-bc41-c0a77e6bd2bb req-2a6b0d00-4e17-42c5-93b7-b8c0311a2ac6 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Updated VIF entry in instance network info cache for port 3bb2f13a-02b4-4872-8b2c-dfb23be94ba1. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG nova.network.neutron [req-cea08ad9-953a-43e4-bc41-c0a77e6bd2bb req-2a6b0d00-4e17-42c5-93b7-b8c0311a2ac6 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Updating instance_info_cache with network_info: [{"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cea08ad9-953a-43e4-bc41-c0a77e6bd2bb req-2a6b0d00-4e17-42c5-93b7-b8c0311a2ac6 service nova] Releasing lock "refresh_cache-bb780430-2cb6-4443-98ed-a224ec35bf57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:36 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Instance destroyed successfully.
Jul 25 15:40:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lazy-loading 'resources' on Instance uuid 8beb6a74-a413-4a75-b8ce-678447cff1a5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1235736738',display_name='tempest-ServersNegativeTestJSON-server-1235736738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1235736738',id=2,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e50fe153def490bae620115f0dc4b50',ramdisk_id='',reservation_id='r-mwym1ych',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-454996836',owner_user_name='tempest-ServersNegativeTestJSON-454996836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:31:59Z,user_data=None,user_id='47d1f853b9564b8ca6e60577241fed35',uuid=8beb6a74-a413-4a75-b8ce-678447cff1a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converting VIF {"id": "8a556969-3c2f-410a-ac20-29e261e06c2a", "address": "fa:16:3e:1c:ac:d2", "network": {"id": "4d6a6b6f-2f00-4e18-857d-c4e0490d4590", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1384164529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e50fe153def490bae620115f0dc4b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a556969-3c", "ovs_interfaceid": "8a556969-3c2f-410a-ac20-29e261e06c2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ac:d2,bridge_name='br-int',has_traffic_filtering=True,id=8a556969-3c2f-410a-ac20-29e261e06c2a,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a556969-3c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG os_vif [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ac:d2,bridge_name='br-int',has_traffic_filtering=True,id=8a556969-3c2f-410a-ac20-29e261e06c2a,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a556969-3c') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a556969-3c, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:40:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:37 user nova-compute[70869]: INFO os_vif [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ac:d2,bridge_name='br-int',has_traffic_filtering=True,id=8a556969-3c2f-410a-ac20-29e261e06c2a,network=Network(4d6a6b6f-2f00-4e18-857d-c4e0490d4590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a556969-3c')
Jul 25 15:40:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Deleting instance files /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5_del
Jul 25 15:40:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Deletion of /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5_del complete
Jul 25 15:40:37 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000002, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/8beb6a74-a413-4a75-b8ce-678447cff1a5/disk
Jul 25 15:40:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:37 user nova-compute[70869]: INFO nova.compute.manager [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Took 1.74 seconds to destroy the instance on the hypervisor.
Jul 25 15:40:37 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299639.8762882, bb780430-2cb6-4443-98ed-a224ec35bf57 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:40:40 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] VM Resumed (Lifecycle Event)
Jul 25 15:40:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-c5299496-42e2-4257-9ed7-43558fa2d6e8 req-63ea5e98-4949-4b77-aa33-78ebdc15ce83 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received event network-vif-deleted-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:40 user nova-compute[70869]: INFO nova.compute.manager [req-c5299496-42e2-4257-9ed7-43558fa2d6e8 req-63ea5e98-4949-4b77-aa33-78ebdc15ce83 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Neutron deleted interface 8a556969-3c2f-410a-ac20-29e261e06c2a; detaching it from the instance and deleting it from the info cache
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.network.neutron [req-c5299496-42e2-4257-9ed7-43558fa2d6e8 req-63ea5e98-4949-4b77-aa33-78ebdc15ce83 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-4cea7359-1b02-4917-8b00-e68447a98efe req-c527c297-7b69-4212-a499-31431bc0d3a7 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received event network-vif-plugged-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4cea7359-1b02-4917-8b00-e68447a98efe req-c527c297-7b69-4212-a499-31431bc0d3a7 service nova] Acquiring lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4cea7359-1b02-4917-8b00-e68447a98efe req-c527c297-7b69-4212-a499-31431bc0d3a7 service nova] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4cea7359-1b02-4917-8b00-e68447a98efe req-c527c297-7b69-4212-a499-31431bc0d3a7 service nova] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-4cea7359-1b02-4917-8b00-e68447a98efe req-c527c297-7b69-4212-a499-31431bc0d3a7 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] No waiting events found dispatching network-vif-plugged-8a556969-3c2f-410a-ac20-29e261e06c2a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:40:40 user nova-compute[70869]: WARNING nova.compute.manager [req-4cea7359-1b02-4917-8b00-e68447a98efe req-c527c297-7b69-4212-a499-31431bc0d3a7 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Received unexpected event network-vif-plugged-8a556969-3c2f-410a-ac20-29e261e06c2a for instance with vm_state active and task_state deleting.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received event network-vif-plugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] No waiting events found dispatching network-vif-plugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:40:40 user nova-compute[70869]: WARNING nova.compute.manager [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received unexpected event network-vif-plugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 for instance with vm_state building and task_state spawning.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received event network-vif-plugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] No waiting events found dispatching network-vif-plugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:40:40 user nova-compute[70869]: WARNING nova.compute.manager [req-f4094b8c-0e0d-418a-ac7a-8593c1442309 req-78017612-46e6-41cf-b790-10d781b3d26e service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received unexpected event network-vif-plugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 for instance with vm_state building and task_state spawning.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:40:40 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Took 3.11 seconds to deallocate network for instance.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:40:40 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:40:40 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7523MB free_disk=25.5604248046875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:40 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299639.8785865, bb780430-2cb6-4443-98ed-a224ec35bf57 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:40:40 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] VM Started (Lifecycle Event)
Jul 25 15:40:40 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Instance spawned successfully.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-c5299496-42e2-4257-9ed7-43558fa2d6e8 req-63ea5e98-4949-4b77-aa33-78ebdc15ce83 service nova] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Detach interface failed, port_id=8a556969-3c2f-410a-ac20-29e261e06c2a, reason: Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:40:40 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:40 user nova-compute[70869]: INFO nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Took 7.88 seconds to spawn the instance on the hypervisor.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 8beb6a74-a413-4a75-b8ce-678447cff1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d384e3b6-8948-4db0-8d39-a340cb130c57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance be3bdffd-27ff-49a8-9aef-ddf374f33752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bb780430-2cb6-4443-98ed-a224ec35bf57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:40:40 user nova-compute[70869]: INFO nova.compute.manager [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Took 8.77 seconds to build instance.
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bfd9ea-9b41-4d6c-aee5-2643e83fd23a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.905s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.510s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:41 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Deleted allocations for instance 8beb6a74-a413-4a75-b8ce-678447cff1a5
Jul 25 15:40:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6256e9be-bc4d-4720-8d78-5885adf1fda1 tempest-ServersNegativeTestJSON-454996836 tempest-ServersNegativeTestJSON-454996836-project-member] Lock "8beb6a74-a413-4a75-b8ce-678447cff1a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.137s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:40:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:40:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:40:43 user nova-compute[70869]: INFO nova.compute.claims [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Claim successful on node user
Jul 25 15:40:44 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:40:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:40:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG nova.policy [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d09efb7dac2429a97ec41381705c5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52ab59c5e0a442aa53ad1edd6b4ec5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:40:44 user nova-compute[70869]: INFO nova.virt.block_device [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Booting with volume 1698b104-634b-4bdf-9890-34e7e05a41e8 at /dev/vda
Jul 25 15:40:44 user nova-compute[70869]: DEBUG os_brick.utils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5946bdf0-4f37-4306-9991-f0406232dd21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[21826d43-342a-4a98-903e-08cbc05a897a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[34084116-9fbf-4117-8097-eb42d693f685]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f6c086-f696-4945-ab1d-e3ad833200f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:40:44 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:40:44 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f081dcb2-b324-49da-8b12-445775bcda6d]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG os_brick.utils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating existing volume attachment record: 2a9cb4be-0463-42ac-a5b1-a7a25f1b46a1 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:40:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:45 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Successfully created port: 32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Successfully updated port: 32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquired lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-3aff35d8-e3da-49bc-90ae-534d4217dcb1 req-894027fb-8f37-46bd-80c0-64a1cc8cd016 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-changed-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-3aff35d8-e3da-49bc-90ae-534d4217dcb1 req-894027fb-8f37-46bd-80c0-64a1cc8cd016 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Refreshing instance network info cache due to event network-changed-32e983c7-b4e5-47f6-ab3a-f82d87ea5273. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3aff35d8-e3da-49bc-90ae-534d4217dcb1 req-894027fb-8f37-46bd-80c0-64a1cc8cd016 service nova] Acquiring lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating instance_info_cache with network_info: [{"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Releasing lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Instance network_info: |[{"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3aff35d8-e3da-49bc-90ae-534d4217dcb1 req-894027fb-8f37-46bd-80c0-64a1cc8cd016 service nova] Acquired lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG nova.network.neutron [req-3aff35d8-e3da-49bc-90ae-534d4217dcb1 req-894027fb-8f37-46bd-80c0-64a1cc8cd016 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Refreshing network info cache for port 32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:40:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:47 user nova-compute[70869]: DEBUG nova.network.neutron [req-3aff35d8-e3da-49bc-90ae-534d4217dcb1 req-894027fb-8f37-46bd-80c0-64a1cc8cd016 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updated VIF entry in instance network info cache for port 32e983c7-b4e5-47f6-ab3a-f82d87ea5273. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:40:47 user nova-compute[70869]: DEBUG nova.network.neutron [req-3aff35d8-e3da-49bc-90ae-534d4217dcb1 req-894027fb-8f37-46bd-80c0-64a1cc8cd016 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating instance_info_cache with network_info: [{"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:40:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3aff35d8-e3da-49bc-90ae-534d4217dcb1 req-894027fb-8f37-46bd-80c0-64a1cc8cd016 service nova] Releasing lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:40:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:51 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299636.9433224, 8beb6a74-a413-4a75-b8ce-678447cff1a5 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:40:51 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] VM Stopped (Lifecycle Event)
Jul 25 15:40:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-bde1f428-a6c9-43d4-9ade-42ebc28e8f90 None None] [instance: 8beb6a74-a413-4a75-b8ce-678447cff1a5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:40:52 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Creating image(s)
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Ensure instance console log exists: /opt/stack/data/nova/instances/bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Start _get_guest_xml network_info=[{"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2a9cb4be-0463-42ac-a5b1-a7a25f1b46a1', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVGfPgEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f', 'attached_at': '', 'detached_at': '', 'volume_id': '1698b104-634b-4bdf-9890-34e7e05a41e8', 'serial': '1698b104-634b-4bdf-9890-34e7e05a41e8'}, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:40:52 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:40:52 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVGfPgEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:40:52 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:40:52 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:40:52 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bc9ae4-91ad-413e-a497-bcac508f5bc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:40:52 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bfec09-5fae-4f81-87f5-2c32a449a0ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8] added
Jul 25 15:40:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bd01c8-4e5b-402e-bb59-7e022deb1595]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c265691-f730-479b-860c-d7d2c232b4ed]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVGfPgEu {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVGfPgEu" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[75562657-7d0d-4ed9-bdda-9b6d83c4452e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BVGfPgEu'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd536227-bae3-4270-b220-00a69ee278dc]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0628bd3b-eebf-43e4-b806-e79d8ab98ecc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:40:52 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:40:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:40:52 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:40:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[994b95cd-b657-4451-a8b0-1d16cc731772]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260]
Jul 25 15:40:52 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260] successful.
Jul 25 15:40:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c48e87-2bba-4f64-8f7d-98fe6451cba5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc374c75-c0c0-4fc5-8c66-8d5805db710a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:40:52 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:40:52 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:40:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:40:52 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:40:52 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:40:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d42d0b6-a5d9-4691-b466-60e92fba40df]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:40:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVGfPgEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23030633935613661', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030633935613661', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873623589',display_name='tempest-ServerActionsTestOtherA-server-1873623589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873623589',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-94gicbbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'pci_devices' on Instance uuid bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:40:53 user nova-compute[70869]:   <uuid>bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f</uuid>
Jul 25 15:40:53 user nova-compute[70869]:   <name>instance-00000019</name>
Jul 25 15:40:53 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:40:53 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:40:53 user nova-compute[70869]:   <metadata>
Jul 25 15:40:53 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:40:53 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:40:53 user nova-compute[70869]:       <nova:name>tempest-ServerActionsTestOtherA-server-1873623589</nova:name>
Jul 25 15:40:53 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:40:52</nova:creationTime>
Jul 25 15:40:53 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:40:53 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:40:53 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:40:53 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:40:53 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:40:53 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:40:53 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:40:53 user nova-compute[70869]:       <nova:owner>
Jul 25 15:40:53 user nova-compute[70869]:         <nova:user uuid="3d09efb7dac2429a97ec41381705c5a5">tempest-ServerActionsTestOtherA-798279085-project-member</nova:user>
Jul 25 15:40:53 user nova-compute[70869]:         <nova:project uuid="f52ab59c5e0a442aa53ad1edd6b4ec5e">tempest-ServerActionsTestOtherA-798279085</nova:project>
Jul 25 15:40:53 user nova-compute[70869]:       </nova:owner>
Jul 25 15:40:53 user nova-compute[70869]:       <nova:ports>
Jul 25 15:40:53 user nova-compute[70869]:         <nova:port uuid="32e983c7-b4e5-47f6-ab3a-f82d87ea5273">
Jul 25 15:40:53 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 15:40:53 user nova-compute[70869]:         </nova:port>
Jul 25 15:40:53 user nova-compute[70869]:       </nova:ports>
Jul 25 15:40:53 user nova-compute[70869]:     </nova:instance>
Jul 25 15:40:53 user nova-compute[70869]:   </metadata>
Jul 25 15:40:53 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:40:53 user nova-compute[70869]:     <system>
Jul 25 15:40:53 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:40:53 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:40:53 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:40:53 user nova-compute[70869]:       <entry name="serial">bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f</entry>
Jul 25 15:40:53 user nova-compute[70869]:       <entry name="uuid">bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f</entry>
Jul 25 15:40:53 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:40:53 user nova-compute[70869]:     </system>
Jul 25 15:40:53 user nova-compute[70869]:   </sysinfo>
Jul 25 15:40:53 user nova-compute[70869]:   <os>
Jul 25 15:40:53 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:40:53 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:40:53 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:40:53 user nova-compute[70869]:   </os>
Jul 25 15:40:53 user nova-compute[70869]:   <features>
Jul 25 15:40:53 user nova-compute[70869]:     <acpi/>
Jul 25 15:40:53 user nova-compute[70869]:     <apic/>
Jul 25 15:40:53 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:40:53 user nova-compute[70869]:   </features>
Jul 25 15:40:53 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:40:53 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:40:53 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:40:53 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:40:53 user nova-compute[70869]:   </clock>
Jul 25 15:40:53 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:40:53 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:40:53 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:40:53 user nova-compute[70869]:   </cpu>
Jul 25 15:40:53 user nova-compute[70869]:   <devices>
Jul 25 15:40:53 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:40:53 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:40:53 user nova-compute[70869]:       <source dev="/dev/sdd"/>
Jul 25 15:40:53 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:40:53 user nova-compute[70869]:       <serial>1698b104-634b-4bdf-9890-34e7e05a41e8</serial>
Jul 25 15:40:53 user nova-compute[70869]:     </disk>
Jul 25 15:40:53 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:40:53 user nova-compute[70869]:       <mac address="fa:16:3e:43:92:82"/>
Jul 25 15:40:53 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:40:53 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:40:53 user nova-compute[70869]:       <target dev="tap32e983c7-b4"/>
Jul 25 15:40:53 user nova-compute[70869]:     </interface>
Jul 25 15:40:53 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:40:53 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f/console.log" append="off"/>
Jul 25 15:40:53 user nova-compute[70869]:     </serial>
Jul 25 15:40:53 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:40:53 user nova-compute[70869]:     <video>
Jul 25 15:40:53 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:40:53 user nova-compute[70869]:     </video>
Jul 25 15:40:53 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:40:53 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:40:53 user nova-compute[70869]:     </rng>
Jul 25 15:40:53 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:40:53 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:40:53 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:40:53 user nova-compute[70869]:     </memballoon>
Jul 25 15:40:53 user nova-compute[70869]:   </devices>
Jul 25 15:40:53 user nova-compute[70869]: </domain>
Jul 25 15:40:53 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873623589',display_name='tempest-ServerActionsTestOtherA-server-1873623589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873623589',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-94gicbbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG os_vif [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32e983c7-b4, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32e983c7-b4, col_values=(('external_ids', {'iface-id': '32e983c7-b4e5-47f6-ab3a-f82d87ea5273', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:92:82', 'vm-uuid': 'bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:40:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:53 user nova-compute[70869]: INFO os_vif [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4')
Jul 25 15:40:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:40:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No VIF found with MAC fa:16:3e:43:92:82, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-588d1483-90d8-455e-93d9-6610feb654bd req-7d347a83-e04e-463e-915f-b81376ad045c service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-588d1483-90d8-455e-93d9-6610feb654bd req-7d347a83-e04e-463e-915f-b81376ad045c service nova] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-588d1483-90d8-455e-93d9-6610feb654bd req-7d347a83-e04e-463e-915f-b81376ad045c service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-588d1483-90d8-455e-93d9-6610feb654bd req-7d347a83-e04e-463e-915f-b81376ad045c service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-588d1483-90d8-455e-93d9-6610feb654bd req-7d347a83-e04e-463e-915f-b81376ad045c service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] No waiting events found dispatching network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:40:55 user nova-compute[70869]: WARNING nova.compute.manager [req-588d1483-90d8-455e-93d9-6610feb654bd req-7d347a83-e04e-463e-915f-b81376ad045c service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received unexpected event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 for instance with vm_state building and task_state spawning.
Jul 25 15:40:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299657.5303996, bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:40:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] VM Resumed (Lifecycle Event)
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:40:57 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Instance spawned successfully.
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:40:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299657.5338206, bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:40:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] VM Started (Lifecycle Event)
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-bd6e879d-692f-425f-84f9-492ffbd8dd70 req-434f2106-20f5-4ae9-90d2-dabe7f598a27 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bd6e879d-692f-425f-84f9-492ffbd8dd70 req-434f2106-20f5-4ae9-90d2-dabe7f598a27 service nova] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bd6e879d-692f-425f-84f9-492ffbd8dd70 req-434f2106-20f5-4ae9-90d2-dabe7f598a27 service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bd6e879d-692f-425f-84f9-492ffbd8dd70 req-434f2106-20f5-4ae9-90d2-dabe7f598a27 service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-bd6e879d-692f-425f-84f9-492ffbd8dd70 req-434f2106-20f5-4ae9-90d2-dabe7f598a27 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] No waiting events found dispatching network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:40:57 user nova-compute[70869]: WARNING nova.compute.manager [req-bd6e879d-692f-425f-84f9-492ffbd8dd70 req-434f2106-20f5-4ae9-90d2-dabe7f598a27 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received unexpected event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 for instance with vm_state building and task_state spawning.
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:40:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:40:57 user nova-compute[70869]: INFO nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Took 5.17 seconds to spawn the instance on the hypervisor.
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:40:57 user nova-compute[70869]: INFO nova.compute.manager [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Took 14.10 seconds to build instance.
Jul 25 15:40:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6188f320-142a-4868-b281-3da24def7595 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.227s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:40:57 user nova-compute[70869]: INFO nova.compute.claims [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Claim successful on node user
Jul 25 15:40:58 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:40:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:40:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:40:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Creating image(s)
Jul 25 15:40:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "/opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "/opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "/opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "7cb9f5ba457adc702ddce8d74f23543c0c6745e5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "7cb9f5ba457adc702ddce8d74f23543c0c6745e5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG nova.policy [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a905cee33a204704937a0224b3e6fab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07ad06e29c4d2dbe409fa13979b81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5.part --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG nova.virt.images [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] ed132aaf-7487-4fae-8bce-0c773d559b1a was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5.part /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5.part /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5.converted" returned: 0 in 0.239s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "7cb9f5ba457adc702ddce8d74f23543c0c6745e5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.078s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Successfully created port: 110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5 --force-share --output=json" returned: 0 in 0.183s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "7cb9f5ba457adc702ddce8d74f23543c0c6745e5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "7cb9f5ba457adc702ddce8d74f23543c0c6745e5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:40:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5 --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5,backing_fmt=raw /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5,backing_fmt=raw /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk 1073741824" returned: 0 in 0.068s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "7cb9f5ba457adc702ddce8d74f23543c0c6745e5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5 --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Cannot resize image /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'migration_context' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Ensure instance console log exists: /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Successfully updated port: 110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquired lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-5f82604f-1e8d-49cd-9d42-f101bb468e56 req-ad002588-e104-46c8-8501-761839710f06 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-5f82604f-1e8d-49cd-9d42-f101bb468e56 req-ad002588-e104-46c8-8501-761839710f06 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing instance network info cache due to event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5f82604f-1e8d-49cd-9d42-f101bb468e56 req-ad002588-e104-46c8-8501-761839710f06 service nova] Acquiring lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updating instance_info_cache with network_info: [{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Releasing lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Instance network_info: |[{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5f82604f-1e8d-49cd-9d42-f101bb468e56 req-ad002588-e104-46c8-8501-761839710f06 service nova] Acquired lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.network.neutron [req-5f82604f-1e8d-49cd-9d42-f101bb468e56 req-ad002588-e104-46c8-8501-761839710f06 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Start _get_guest_xml network_info=[{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:40:55Z,direct_url=<?>,disk_format='qcow2',id=ed132aaf-7487-4fae-8bce-0c773d559b1a,min_disk=0,min_ram=0,name='tempest-scenario-img--984767203',owner='4c07ad06e29c4d2dbe409fa13979b81b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:40:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'ed132aaf-7487-4fae-8bce-0c773d559b1a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:41:01 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:01 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:40:55Z,direct_url=<?>,disk_format='qcow2',id=ed132aaf-7487-4fae-8bce-0c773d559b1a,min_disk=0,min_ram=0,name='tempest-scenario-img--984767203',owner='4c07ad06e29c4d2dbe409fa13979b81b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:40:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1969392480',display_name='tempest-TestMinimumBasicScenario-server-1969392480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1969392480',id=26,image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQgML7ATcFoxWxXjJc8agfkcR/GfGqrezO6JWItXGR4qsG0lUjNUHSBon21VdVXFvHrM1OdFDo7u7bX5JOxfW5DD+4X3WzLxSXlFymCahyF2wWw3cygbBT4zMhy49Dx6w==',key_name='tempest-TestMinimumBasicScenario-2020211488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c07ad06e29c4d2dbe409fa13979b81b',ramdisk_id='',reservation_id='r-evznqodo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1773990321',owner_user_name='tempest-TestMinimumBasicScenario-1773990321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:40:58Z,user_data=None,user_id='a905cee33a204704937a0224b3e6fab1',uuid=e69fa561-b002-49d7-8251-3de03ae44940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converting VIF {"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'pci_devices' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:41:01 user nova-compute[70869]:   <uuid>e69fa561-b002-49d7-8251-3de03ae44940</uuid>
Jul 25 15:41:01 user nova-compute[70869]:   <name>instance-0000001a</name>
Jul 25 15:41:01 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:41:01 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:41:01 user nova-compute[70869]:   <metadata>
Jul 25 15:41:01 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:41:01 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:41:01 user nova-compute[70869]:       <nova:name>tempest-TestMinimumBasicScenario-server-1969392480</nova:name>
Jul 25 15:41:01 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:41:01</nova:creationTime>
Jul 25 15:41:01 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:41:01 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:41:01 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:41:01 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:41:01 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:41:01 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:41:01 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:41:01 user nova-compute[70869]:       <nova:owner>
Jul 25 15:41:01 user nova-compute[70869]:         <nova:user uuid="a905cee33a204704937a0224b3e6fab1">tempest-TestMinimumBasicScenario-1773990321-project-member</nova:user>
Jul 25 15:41:01 user nova-compute[70869]:         <nova:project uuid="4c07ad06e29c4d2dbe409fa13979b81b">tempest-TestMinimumBasicScenario-1773990321</nova:project>
Jul 25 15:41:01 user nova-compute[70869]:       </nova:owner>
Jul 25 15:41:01 user nova-compute[70869]:       <nova:root type="image" uuid="ed132aaf-7487-4fae-8bce-0c773d559b1a"/>
Jul 25 15:41:01 user nova-compute[70869]:       <nova:ports>
Jul 25 15:41:01 user nova-compute[70869]:         <nova:port uuid="110266bd-c366-4bb6-981f-608cfc13ab13">
Jul 25 15:41:01 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 15:41:01 user nova-compute[70869]:         </nova:port>
Jul 25 15:41:01 user nova-compute[70869]:       </nova:ports>
Jul 25 15:41:01 user nova-compute[70869]:     </nova:instance>
Jul 25 15:41:01 user nova-compute[70869]:   </metadata>
Jul 25 15:41:01 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:41:01 user nova-compute[70869]:     <system>
Jul 25 15:41:01 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:41:01 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:41:01 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:41:01 user nova-compute[70869]:       <entry name="serial">e69fa561-b002-49d7-8251-3de03ae44940</entry>
Jul 25 15:41:01 user nova-compute[70869]:       <entry name="uuid">e69fa561-b002-49d7-8251-3de03ae44940</entry>
Jul 25 15:41:01 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:41:01 user nova-compute[70869]:     </system>
Jul 25 15:41:01 user nova-compute[70869]:   </sysinfo>
Jul 25 15:41:01 user nova-compute[70869]:   <os>
Jul 25 15:41:01 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:41:01 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:41:01 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:41:01 user nova-compute[70869]:   </os>
Jul 25 15:41:01 user nova-compute[70869]:   <features>
Jul 25 15:41:01 user nova-compute[70869]:     <acpi/>
Jul 25 15:41:01 user nova-compute[70869]:     <apic/>
Jul 25 15:41:01 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:41:01 user nova-compute[70869]:   </features>
Jul 25 15:41:01 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:41:01 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:41:01 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:41:01 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:41:01 user nova-compute[70869]:   </clock>
Jul 25 15:41:01 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:41:01 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:41:01 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:41:01 user nova-compute[70869]:   </cpu>
Jul 25 15:41:01 user nova-compute[70869]:   <devices>
Jul 25 15:41:01 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:41:01 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:41:01 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk"/>
Jul 25 15:41:01 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:41:01 user nova-compute[70869]:     </disk>
Jul 25 15:41:01 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:41:01 user nova-compute[70869]:       <mac address="fa:16:3e:4a:f2:ce"/>
Jul 25 15:41:01 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:41:01 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:41:01 user nova-compute[70869]:       <target dev="tap110266bd-c3"/>
Jul 25 15:41:01 user nova-compute[70869]:     </interface>
Jul 25 15:41:01 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:41:01 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/console.log" append="off"/>
Jul 25 15:41:01 user nova-compute[70869]:     </serial>
Jul 25 15:41:01 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:41:01 user nova-compute[70869]:     <video>
Jul 25 15:41:01 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:41:01 user nova-compute[70869]:     </video>
Jul 25 15:41:01 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:41:01 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:41:01 user nova-compute[70869]:     </rng>
Jul 25 15:41:01 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:41:01 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:41:01 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:41:01 user nova-compute[70869]:     </memballoon>
Jul 25 15:41:01 user nova-compute[70869]:   </devices>
Jul 25 15:41:01 user nova-compute[70869]: </domain>
Jul 25 15:41:01 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1969392480',display_name='tempest-TestMinimumBasicScenario-server-1969392480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1969392480',id=26,image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQgML7ATcFoxWxXjJc8agfkcR/GfGqrezO6JWItXGR4qsG0lUjNUHSBon21VdVXFvHrM1OdFDo7u7bX5JOxfW5DD+4X3WzLxSXlFymCahyF2wWw3cygbBT4zMhy49Dx6w==',key_name='tempest-TestMinimumBasicScenario-2020211488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c07ad06e29c4d2dbe409fa13979b81b',ramdisk_id='',reservation_id='r-evznqodo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1773990321',owner_user_name='tempest-TestMinimumBasicScenario-1773990321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:40:58Z,user_data=None,user_id='a905cee33a204704937a0224b3e6fab1',uuid=e69fa561-b002-49d7-8251-3de03ae44940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converting VIF {"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG os_vif [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap110266bd-c3, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap110266bd-c3, col_values=(('external_ids', {'iface-id': '110266bd-c366-4bb6-981f-608cfc13ab13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:f2:ce', 'vm-uuid': 'e69fa561-b002-49d7-8251-3de03ae44940'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:01 user nova-compute[70869]: INFO os_vif [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3')
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No VIF found with MAC fa:16:3e:4a:f2:ce, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:41:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-5f82604f-1e8d-49cd-9d42-f101bb468e56 req-ad002588-e104-46c8-8501-761839710f06 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updated VIF entry in instance network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:41:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-5f82604f-1e8d-49cd-9d42-f101bb468e56 req-ad002588-e104-46c8-8501-761839710f06 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updating instance_info_cache with network_info: [{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5f82604f-1e8d-49cd-9d42-f101bb468e56 req-ad002588-e104-46c8-8501-761839710f06 service nova] Releasing lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-6663a88a-52af-4838-8e70-c8862108be0b req-895c57a9-cab6-420c-b62a-5fe683340e76 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6663a88a-52af-4838-8e70-c8862108be0b req-895c57a9-cab6-420c-b62a-5fe683340e76 service nova] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6663a88a-52af-4838-8e70-c8862108be0b req-895c57a9-cab6-420c-b62a-5fe683340e76 service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6663a88a-52af-4838-8e70-c8862108be0b req-895c57a9-cab6-420c-b62a-5fe683340e76 service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:03 user nova-compute[70869]: DEBUG nova.compute.manager [req-6663a88a-52af-4838-8e70-c8862108be0b req-895c57a9-cab6-420c-b62a-5fe683340e76 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] No waiting events found dispatching network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:03 user nova-compute[70869]: WARNING nova.compute.manager [req-6663a88a-52af-4838-8e70-c8862108be0b req-895c57a9-cab6-420c-b62a-5fe683340e76 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received unexpected event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 for instance with vm_state building and task_state spawning.
Jul 25 15:41:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:04 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'flavor' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:04 user nova-compute[70869]: INFO nova.compute.manager [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Attaching volume 6705f875-bf92-4305-8d7d-6d56c565bbf6 to /dev/vdb
Jul 25 15:41:04 user nova-compute[70869]: DEBUG os_brick.utils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[028a6bc7-1718-4b09-b808-77407a327ebe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df6e972-38c5-4ea8-b857-69c81b1b9d81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1073b4df-9274-4b46-8ef2-9783cd31901f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a7f80d-5658-4fc0-936d-a0645051afa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:05 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb440d5b-2529-4eb8-8768-3832640b963e]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG os_brick.utils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating existing volume attachment record: 544492dd-1958-400a-be4b-d7e0a8da6c14 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299665.1583896, e69fa561-b002-49d7-8251-3de03ae44940 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:41:05 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] VM Resumed (Lifecycle Event)
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:41:05 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Instance spawned successfully.
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:41:05 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299665.1654627, e69fa561-b002-49d7-8251-3de03ae44940 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:41:05 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] VM Started (Lifecycle Event)
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:41:05 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:41:05 user nova-compute[70869]: INFO nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Took 6.74 seconds to spawn the instance on the hypervisor.
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-99f448e3-d1c2-4b13-a7a7-a7f20a62bf51 req-436f3409-f550-4276-bffb-cc1c0c7fec83 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-99f448e3-d1c2-4b13-a7a7-a7f20a62bf51 req-436f3409-f550-4276-bffb-cc1c0c7fec83 service nova] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-99f448e3-d1c2-4b13-a7a7-a7f20a62bf51 req-436f3409-f550-4276-bffb-cc1c0c7fec83 service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-99f448e3-d1c2-4b13-a7a7-a7f20a62bf51 req-436f3409-f550-4276-bffb-cc1c0c7fec83 service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-99f448e3-d1c2-4b13-a7a7-a7f20a62bf51 req-436f3409-f550-4276-bffb-cc1c0c7fec83 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] No waiting events found dispatching network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:05 user nova-compute[70869]: WARNING nova.compute.manager [req-99f448e3-d1c2-4b13-a7a7-a7f20a62bf51 req-436f3409-f550-4276-bffb-cc1c0c7fec83 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received unexpected event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 for instance with vm_state building and task_state spawning.
Jul 25 15:41:05 user nova-compute[70869]: INFO nova.compute.manager [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Took 7.59 seconds to build instance.
Jul 25 15:41:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f3219c8e-4908-4c45-94bf-4d66d22f1096 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.682s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:12 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:12 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:12 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ce27c3-8066-4681-ab5d-de2aaee855a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:41:12 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d8c782-b1cb-4b6a-9022-3acff8f421e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6] added
Jul 25 15:41:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dce787c-9898-43cf-98f7-685de724ceba]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[84462edd-658b-4274-b395-d096fd2887a5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYkqcBAt {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYkqcBAt" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a575c785-9069-415a-86e1-4876dab63745]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PYkqcBAt'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0db34b4-a0b4-49c7-b2f1-f482dfc70a15]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbaa7e5-bdfc-4197-b73b-7bcb677a3813]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b84b22c-37d6-4ef2-9d44-d29d93f6f8d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]
Jul 25 15:41:12 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.
Jul 25 15:41:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7395b78e-3aae-42d9-882c-546456f50f68]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2f7f3-1542-4c75-91cb-c4d9f8cf56e3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b15908-40ca-4657-b9bc-4b0a67d2c9bc]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:41:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:41:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23333313036353761', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333313036353761', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:41:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'flavor' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:41:13 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:41:13 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:41:13 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:41:13 user nova-compute[70869]:   <serial>6705f875-bf92-4305-8d7d-6d56c565bbf6</serial>
Jul 25 15:41:13 user nova-compute[70869]: </disk>
Jul 25 15:41:13 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:41:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] No VIF found with MAC fa:16:3e:e3:a3:59, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:41:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d6f484e7-e548-4444-b871-ddfde83480f2 tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.611s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-10e83cd7-1057-4f59-9726-df4e0a30a55b req-968ca42b-c3d7-4c06-9850-21efbee3d752 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-changed-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-10e83cd7-1057-4f59-9726-df4e0a30a55b req-968ca42b-c3d7-4c06-9850-21efbee3d752 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Refreshing instance network info cache due to event network-changed-f71a78b3-ec67-4803-95e3-2490492edd10. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-10e83cd7-1057-4f59-9726-df4e0a30a55b req-968ca42b-c3d7-4c06-9850-21efbee3d752 service nova] Acquiring lock "refresh_cache-be3bdffd-27ff-49a8-9aef-ddf374f33752" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-10e83cd7-1057-4f59-9726-df4e0a30a55b req-968ca42b-c3d7-4c06-9850-21efbee3d752 service nova] Acquired lock "refresh_cache-be3bdffd-27ff-49a8-9aef-ddf374f33752" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG nova.network.neutron [req-10e83cd7-1057-4f59-9726-df4e0a30a55b req-968ca42b-c3d7-4c06-9850-21efbee3d752 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Refreshing network info cache for port f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Stashing vm_state: active {{(pid=70869) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'pci_requests' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:41:16 user nova-compute[70869]: INFO nova.compute.claims [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Claim successful on node user
Jul 25 15:41:16 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'resources' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:16 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'pci_devices' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:16 user nova-compute[70869]: INFO nova.compute.resource_tracker [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating resource usage from migration 94cc0e72-05b0-4894-894d-686ed1154513
Jul 25 15:41:17 user nova-compute[70869]: DEBUG nova.network.neutron [req-10e83cd7-1057-4f59-9726-df4e0a30a55b req-968ca42b-c3d7-4c06-9850-21efbee3d752 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Updated VIF entry in instance network info cache for port f71a78b3-ec67-4803-95e3-2490492edd10. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG nova.network.neutron [req-10e83cd7-1057-4f59-9726-df4e0a30a55b req-968ca42b-c3d7-4c06-9850-21efbee3d752 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Updating instance_info_cache with network_info: [{"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-10e83cd7-1057-4f59-9726-df4e0a30a55b req-968ca42b-c3d7-4c06-9850-21efbee3d752 service nova] Releasing lock "refresh_cache-be3bdffd-27ff-49a8-9aef-ddf374f33752" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lazy-loading 'flavor' on Instance uuid be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.549s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:17 user nova-compute[70869]: INFO nova.compute.manager [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Migrating
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:17 user nova-compute[70869]: INFO nova.compute.rpcapi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:17 user nova-compute[70869]: INFO nova.compute.manager [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Attaching volume 6570846b-51a6-492d-9176-94a72d635c10 to /dev/vdb
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquired lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG os_brick.utils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ea033a-91f2-4cbe-829c-008df42f31c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcbe9f7-385e-4c1a-b525-4866f4513913]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f831ed-378a-45ee-abcb-ce60e3b8f944]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[28789538-480d-4485-804a-c55bcc41bd1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:17 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:41:17 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d9898d-a992-4c54-8389-581f4635460e]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG os_brick.utils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Updating existing volume attachment record: 098016d5-fdb1-4b0b-bfd1-16df68daf79e {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:41:17 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance_info_cache with network_info: [{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Releasing lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Starting migrate_disk_and_power_off {{(pid=70869) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-3ef9e38b-b961-42e4-b3c1-4fa163bf37d6 req-ca0f5605-09b3-43da-a69f-32f38a5ac746 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-unplugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3ef9e38b-b961-42e4-b3c1-4fa163bf37d6 req-ca0f5605-09b3-43da-a69f-32f38a5ac746 service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3ef9e38b-b961-42e4-b3c1-4fa163bf37d6 req-ca0f5605-09b3-43da-a69f-32f38a5ac746 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3ef9e38b-b961-42e4-b3c1-4fa163bf37d6 req-ca0f5605-09b3-43da-a69f-32f38a5ac746 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-3ef9e38b-b961-42e4-b3c1-4fa163bf37d6 req-ca0f5605-09b3-43da-a69f-32f38a5ac746 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-unplugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:18 user nova-compute[70869]: WARNING nova.compute.manager [req-3ef9e38b-b961-42e4-b3c1-4fa163bf37d6 req-ca0f5605-09b3-43da-a69f-32f38a5ac746 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-unplugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state active and task_state resize_migrating.
Jul 25 15:41:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:19 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance destroyed successfully.
Jul 25 15:41:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-244416485',display_name='tempest-ServerActionsTestOtherB-server-244416485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-244416485',id=19,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCXboWq8wEzceGCnyi332NqxevvINDJCRjntKF4hIJqpSF49+vs1jbRHF6AATQTYe8No7x4pmRlaWfwGgtbv6ak2EUh6sjCd7bivOrD55NzuNL4hDOGe4J6h+BwET+hSw==',key_name='tempest-keypair-273420356',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:37:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a893391d45fd4eafa016e42722702ac2',ramdisk_id='',reservation_id='r-mt2igj69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1757328199',owner_user_name='tempest-ServerActionsTestOtherB-1757328199-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:41:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5363af86370d49bd8082de16ae83a936',uuid=d384e3b6-8948-4db0-8d39-a340cb130c57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1360392007-network", "vif_mac": "fa:16:3e:e3:a3:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converting VIF {"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1360392007-network", "vif_mac": "fa:16:3e:e3:a3:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_vif [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeebac77a-94, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:19 user nova-compute[70869]: INFO os_vif [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94')
Jul 25 15:41:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:19 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b7993f-ac7d-4634-aee5-c3f10fd6785a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:41:19 user nova-compute[70869]: No targets found.
Jul 25 15:41:19 user nova-compute[70869]: iSNS:
Jul 25 15:41:19 user nova-compute[70869]: No targets found.
Jul 25 15:41:19 user nova-compute[70869]: STATIC:
Jul 25 15:41:19 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16
Jul 25 15:41:19 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:19 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:19 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:41:19 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:19 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:19 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:41:19 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:19 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:19 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:41:19 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:19 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:19 user nova-compute[70869]: FIRMWARE:
Jul 25 15:41:19 user nova-compute[70869]: No targets found.
Jul 25 15:41:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:41:19 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:41:19 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec53ad7d-defe-46e7-b562-e566179ecc70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9b7061-9f40-4e1f-b343-a842cc956982]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:19 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:19 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:19 user nova-compute[70869]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:19 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:19 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:19 user nova-compute[70869]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c37b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[474418a9-c184-4a2d-b72c-8aa9739e77c2]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d744fbc-7caa-455c-b624-0f5668565d67]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04f58c-b012-409f-86ce-a8a0be705bef]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ad5dcb-c4ca-4194-bafa-24e021ca0ead]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0533ed-c1a9-48bf-9dee-68f49e091d4a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ebf80d-6f2d-4889-91a0-39b006218fff]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]
Jul 25 15:41:19 user nova-compute[70869]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.
Jul 25 15:41:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c911589-310f-4e56-b28a-0871bbff281d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] <== disconnect_volume: return (345ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:41:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57_resize/disk /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "cp -r /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57_resize/disk /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk" returned: 0 in 0.476s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57_resize/disk.info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk.info {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "cp -r /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57_resize/disk.info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk.info" returned: 0 in 0.033s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-5a14eaa4-6e3c-42c7-943c-9ff91f188eef req-fefb2cda-16b1-4305-8d9f-0c7ec5e8c5bd service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5a14eaa4-6e3c-42c7-943c-9ff91f188eef req-fefb2cda-16b1-4305-8d9f-0c7ec5e8c5bd service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5a14eaa4-6e3c-42c7-943c-9ff91f188eef req-fefb2cda-16b1-4305-8d9f-0c7ec5e8c5bd service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5a14eaa4-6e3c-42c7-943c-9ff91f188eef req-fefb2cda-16b1-4305-8d9f-0c7ec5e8c5bd service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-5a14eaa4-6e3c-42c7-943c-9ff91f188eef req-fefb2cda-16b1-4305-8d9f-0c7ec5e8c5bd service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:20 user nova-compute[70869]: WARNING nova.compute.manager [req-5a14eaa4-6e3c-42c7-943c-9ff91f188eef req-fefb2cda-16b1-4305-8d9f-0c7ec5e8c5bd service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state active and task_state resize_migrating.
Jul 25 15:41:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Port eebac77a-9411-485f-b850-c2798d0b4b24 binding to destination host user is already ACTIVE {{(pid=70869) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 25 15:41:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquired lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance_info_cache with network_info: [{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Releasing lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG os_brick.utils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4dcdc1-bed2-4be5-9115-0ebedf04e4de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e90f5b7-abfc-4e5d-9105-2ad55bd177c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2636e1-5235-4bb7-9b95-91d81065b7bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20a6083-4fef-49a9-ac14-ff53bcd35a79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:22 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:41:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d7fb3a-fdb6-4038-8552-51ebd97b0b11]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:41:22 user nova-compute[70869]: DEBUG os_brick.utils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jESQuwBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:24 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:24 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:24 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a7ec28-3737-462c-8ef3-5e95898bb184]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:41:24 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5835a3-4c7b-4d37-88ea-882f14191d2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10] added
Jul 25 15:41:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed86c237-1f3e-427b-94c2-d61ac9c03295]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2025b8c4-5670-4ea8-a6c5-f16731d8f82b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jESQuwBV {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jESQuwBV" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[504220c6-5f76-423b-bd37-414605303d56]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jESQuwBV'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2139965a-1745-47ed-b300-0c5d81a709d9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[87331f09-28ef-407c-9d21-4f0d5e2db91b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a3d4b5-ef96-4909-a5fc-7ab61713c505]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10, portal: 172.16.0.220,3260]
Jul 25 15:41:24 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10, portal: 172.16.0.220,3260] successful.
Jul 25 15:41:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cef433-88b3-4c5e-be50-18e7c3e003da]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[64585206-0679-44bc-8d1a-0030ad7c4e54]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[63390e99-3f92-42c6-af9d-9c1f6529d5ec]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:41:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jESQuwBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:41:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23331316166643733', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331316166643733', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:41:25 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lazy-loading 'flavor' on Instance uuid be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:41:25 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:41:25 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:41:25 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:41:25 user nova-compute[70869]:   <serial>6570846b-51a6-492d-9176-94a72d635c10</serial>
Jul 25 15:41:25 user nova-compute[70869]: </disk>
Jul 25 15:41:25 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:41:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] No VIF found with MAC fa:16:3e:39:42:48, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:41:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce3d58d9-9cb1-4b6a-827f-02de7796e441 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.938s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Starting finish_migration {{(pid=70869) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 25 15:41:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance directory exists: not creating {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 15:41:29 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Creating image(s)
Jul 25 15:41:29 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'trusted_certs' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.162s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:29 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk. size=21474836480 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:41:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk 21474836480 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk 21474836480" returned: 0 in 0.047s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Ensure instance console log exists: /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Start _get_guest_xml network_info=[{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1360392007-network", "vif_mac": "fa:16:3e:e3:a3:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '97728853-55a6-47c6-850d-a5f893bed09f', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd384e3b6-8948-4db0-8d39-a340cb130c57', 'attached_at': '2023-07-25T15:41:29.000000', 'detached_at': '', 'volume_id': '6705f875-bf92-4305-8d7d-6d56c565bbf6', 'serial': '6705f875-bf92-4305-8d7d-6d56c565bbf6'}, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:41:30 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:30 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'vcpu_model' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:30 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:30 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:30 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac1e92-cdf2-40e2-8b1d-763abfba2c46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:41:30 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3bc491-984f-4db4-9738-13c6ed0ebf2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6] added
Jul 25 15:41:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d875ebef-4c20-47a0-9e12-29d580d2da59]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[09563069-add4-4a1a-88e6-8196bbd22a9e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYkqcBAt {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYkqcBAt" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a72258c-9347-4e11-9214-1a2c5094407a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PYkqcBAt'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c0fdb-ae3f-46f4-a2f7-999090fcfb02]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40e4c1c-2891-4bec-b31a-32882a658c49]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80911c6-d9ec-4445-a2a1-73e270562d80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]
Jul 25 15:41:30 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.
Jul 25 15:41:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8a80cc-ac76-4702-adc7-e37d40da09e8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1289b1c3-bcb3-42ba-ad50-6c14d6981512]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:30 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab09c5c-e752-48a1-89d0-121c67217fea]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.objects.instance [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lazy-loading 'flavor' on Instance uuid be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:31 user nova-compute[70869]: INFO nova.compute.manager [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Attaching volume d46da1f3-eab8-403e-94cf-2726b5b95f6e to /dev/vdc
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.utils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[051b1cb2-9d60-4ff4-9432-7869771b88c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[184b4c58-6cbc-4c88-944a-4081d4904579]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eb0b19-4a80-49b6-9326-2c5445acff6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c0e738-6e1b-429e-b591-d423f0cc4843]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:31 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:41:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aaee9a-ccab-4584-afa0-9289abd4b433]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.utils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Updating existing volume attachment record: 6dab190a-5f12-4e61-a6ab-af5526400314 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23333313036353761', 'path': '/dev/sdf'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333313036353761', 'path': '/dev/sdf'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-244416485',display_name='tempest-ServerActionsTestOtherB-server-244416485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-244416485',id=19,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCXboWq8wEzceGCnyi332NqxevvINDJCRjntKF4hIJqpSF49+vs1jbRHF6AATQTYe8No7x4pmRlaWfwGgtbv6ak2EUh6sjCd7bivOrD55NzuNL4hDOGe4J6h+BwET+hSw==',key_name='tempest-keypair-273420356',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:37:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a893391d45fd4eafa016e42722702ac2',ramdisk_id='',reservation_id='r-mt2igj69',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1757328199',owner_user_name='tempest-ServerActionsTestOtherB-1757328199-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5363af86370d49bd8082de16ae83a936',uuid=d384e3b6-8948-4db0-8d39-a340cb130c57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1360392007-network", "vif_mac": "fa:16:3e:e3:a3:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converting VIF {"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1360392007-network", "vif_mac": "fa:16:3e:e3:a3:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:41:31 user nova-compute[70869]:   <uuid>d384e3b6-8948-4db0-8d39-a340cb130c57</uuid>
Jul 25 15:41:31 user nova-compute[70869]:   <name>instance-00000013</name>
Jul 25 15:41:31 user nova-compute[70869]:   <memory>2097152</memory>
Jul 25 15:41:31 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:41:31 user nova-compute[70869]:   <metadata>
Jul 25 15:41:31 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:41:31 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:41:31 user nova-compute[70869]:       <nova:name>tempest-ServerActionsTestOtherB-server-244416485</nova:name>
Jul 25 15:41:31 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:41:30</nova:creationTime>
Jul 25 15:41:31 user nova-compute[70869]:       <nova:flavor name="m1.small">
Jul 25 15:41:31 user nova-compute[70869]:         <nova:memory>2048</nova:memory>
Jul 25 15:41:31 user nova-compute[70869]:         <nova:disk>20</nova:disk>
Jul 25 15:41:31 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:41:31 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:41:31 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:41:31 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:41:31 user nova-compute[70869]:       <nova:owner>
Jul 25 15:41:31 user nova-compute[70869]:         <nova:user uuid="5363af86370d49bd8082de16ae83a936">tempest-ServerActionsTestOtherB-1757328199-project-member</nova:user>
Jul 25 15:41:31 user nova-compute[70869]:         <nova:project uuid="a893391d45fd4eafa016e42722702ac2">tempest-ServerActionsTestOtherB-1757328199</nova:project>
Jul 25 15:41:31 user nova-compute[70869]:       </nova:owner>
Jul 25 15:41:31 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:41:31 user nova-compute[70869]:       <nova:ports>
Jul 25 15:41:31 user nova-compute[70869]:         <nova:port uuid="eebac77a-9411-485f-b850-c2798d0b4b24">
Jul 25 15:41:31 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 15:41:31 user nova-compute[70869]:         </nova:port>
Jul 25 15:41:31 user nova-compute[70869]:       </nova:ports>
Jul 25 15:41:31 user nova-compute[70869]:     </nova:instance>
Jul 25 15:41:31 user nova-compute[70869]:   </metadata>
Jul 25 15:41:31 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:41:31 user nova-compute[70869]:     <system>
Jul 25 15:41:31 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:41:31 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:41:31 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:41:31 user nova-compute[70869]:       <entry name="serial">d384e3b6-8948-4db0-8d39-a340cb130c57</entry>
Jul 25 15:41:31 user nova-compute[70869]:       <entry name="uuid">d384e3b6-8948-4db0-8d39-a340cb130c57</entry>
Jul 25 15:41:31 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:41:31 user nova-compute[70869]:     </system>
Jul 25 15:41:31 user nova-compute[70869]:   </sysinfo>
Jul 25 15:41:31 user nova-compute[70869]:   <os>
Jul 25 15:41:31 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:41:31 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:41:31 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:41:31 user nova-compute[70869]:   </os>
Jul 25 15:41:31 user nova-compute[70869]:   <features>
Jul 25 15:41:31 user nova-compute[70869]:     <acpi/>
Jul 25 15:41:31 user nova-compute[70869]:     <apic/>
Jul 25 15:41:31 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:41:31 user nova-compute[70869]:   </features>
Jul 25 15:41:31 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:41:31 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:41:31 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:41:31 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:41:31 user nova-compute[70869]:   </clock>
Jul 25 15:41:31 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:41:31 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:41:31 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:41:31 user nova-compute[70869]:   </cpu>
Jul 25 15:41:31 user nova-compute[70869]:   <devices>
Jul 25 15:41:31 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:41:31 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:41:31 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk"/>
Jul 25 15:41:31 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:41:31 user nova-compute[70869]:     </disk>
Jul 25 15:41:31 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:41:31 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:41:31 user nova-compute[70869]:       <source dev="/dev/sdf"/>
Jul 25 15:41:31 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:41:31 user nova-compute[70869]:       <serial>6705f875-bf92-4305-8d7d-6d56c565bbf6</serial>
Jul 25 15:41:31 user nova-compute[70869]:     </disk>
Jul 25 15:41:31 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:41:31 user nova-compute[70869]:       <mac address="fa:16:3e:e3:a3:59"/>
Jul 25 15:41:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:41:31 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:41:31 user nova-compute[70869]:       <target dev="tapeebac77a-94"/>
Jul 25 15:41:31 user nova-compute[70869]:     </interface>
Jul 25 15:41:31 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:41:31 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/console.log" append="off"/>
Jul 25 15:41:31 user nova-compute[70869]:     </serial>
Jul 25 15:41:31 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:41:31 user nova-compute[70869]:     <video>
Jul 25 15:41:31 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:41:31 user nova-compute[70869]:     </video>
Jul 25 15:41:31 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:41:31 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:41:31 user nova-compute[70869]:     </rng>
Jul 25 15:41:31 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:41:31 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:41:31 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:41:31 user nova-compute[70869]:     </memballoon>
Jul 25 15:41:31 user nova-compute[70869]:   </devices>
Jul 25 15:41:31 user nova-compute[70869]: </domain>
Jul 25 15:41:31 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-244416485',display_name='tempest-ServerActionsTestOtherB-server-244416485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-244416485',id=19,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCXboWq8wEzceGCnyi332NqxevvINDJCRjntKF4hIJqpSF49+vs1jbRHF6AATQTYe8No7x4pmRlaWfwGgtbv6ak2EUh6sjCd7bivOrD55NzuNL4hDOGe4J6h+BwET+hSw==',key_name='tempest-keypair-273420356',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:37:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a893391d45fd4eafa016e42722702ac2',ramdisk_id='',reservation_id='r-mt2igj69',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1757328199',owner_user_name='tempest-ServerActionsTestOtherB-1757328199-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5363af86370d49bd8082de16ae83a936',uuid=d384e3b6-8948-4db0-8d39-a340cb130c57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1360392007-network", "vif_mac": "fa:16:3e:e3:a3:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converting VIF {"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1360392007-network", "vif_mac": "fa:16:3e:e3:a3:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG os_vif [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeebac77a-94, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeebac77a-94, col_values=(('external_ids', {'iface-id': 'eebac77a-9411-485f-b850-c2798d0b4b24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:a3:59', 'vm-uuid': 'd384e3b6-8948-4db0-8d39-a340cb130c57'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:31 user nova-compute[70869]: INFO os_vif [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94')
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] No VIF found with MAC fa:16:3e:e3:a3:59, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:41:32 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:32 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-df99d124-f02c-4de6-801e-a4a31eec014c req-361c3837-1a8b-417f-a807-d7340685760e service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df99d124-f02c-4de6-801e-a4a31eec014c req-361c3837-1a8b-417f-a807-d7340685760e service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df99d124-f02c-4de6-801e-a4a31eec014c req-361c3837-1a8b-417f-a807-d7340685760e service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-df99d124-f02c-4de6-801e-a4a31eec014c req-361c3837-1a8b-417f-a807-d7340685760e service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-df99d124-f02c-4de6-801e-a4a31eec014c req-361c3837-1a8b-417f-a807-d7340685760e service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:33 user nova-compute[70869]: WARNING nova.compute.manager [req-df99d124-f02c-4de6-801e-a4a31eec014c req-361c3837-1a8b-417f-a807-d7340685760e service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state active and task_state resize_finish.
Jul 25 15:41:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:33 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299678.9940922, d384e3b6-8948-4db0-8d39-a340cb130c57 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:41:33 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] VM Stopped (Lifecycle Event)
Jul 25 15:41:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f5cff57c-a4ab-466e-87c1-846fb6ea5d84 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating instance_info_cache with network_info: [{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:41:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:34 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:41:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-0c96c2dd-f9af-4ae8-ad14-ec582b1bec4a req-4a6f2765-3f3f-484a-9632-d1520ee91695 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0c96c2dd-f9af-4ae8-ad14-ec582b1bec4a req-4a6f2765-3f3f-484a-9632-d1520ee91695 service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0c96c2dd-f9af-4ae8-ad14-ec582b1bec4a req-4a6f2765-3f3f-484a-9632-d1520ee91695 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0c96c2dd-f9af-4ae8-ad14-ec582b1bec4a req-4a6f2765-3f3f-484a-9632-d1520ee91695 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-0c96c2dd-f9af-4ae8-ad14-ec582b1bec4a req-4a6f2765-3f3f-484a-9632-d1520ee91695 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:35 user nova-compute[70869]: WARNING nova.compute.manager [req-0c96c2dd-f9af-4ae8-ad14-ec582b1bec4a req-4a6f2765-3f3f-484a-9632-d1520ee91695 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state active and task_state resize_finish.
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299695.6958797, d384e3b6-8948-4db0-8d39-a340cb130c57 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:41:35 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] VM Resumed (Lifecycle Event)
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:41:35 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance running successfully.
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Failed to set time: agent not configured {{(pid=70869) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b5f58b89-59af-499a-91ac-0f8a3f4e115b tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] finish_migration finished successfully. {{(pid=70869) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:41:35 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299695.6964142, d384e3b6-8948-4db0-8d39-a340cb130c57 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:41:35 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] VM Started (Lifecycle Event)
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:35 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:37 user nova-compute[70869]: INFO nova.compute.manager [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Terminating instance
Jul 25 15:41:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-4cf89ac7-2c5e-4b05-97b9-235754417573 req-02bb72c2-39f1-499e-aa02-8b774a65797f service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-vif-unplugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4cf89ac7-2c5e-4b05-97b9-235754417573 req-02bb72c2-39f1-499e-aa02-8b774a65797f service nova] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4cf89ac7-2c5e-4b05-97b9-235754417573 req-02bb72c2-39f1-499e-aa02-8b774a65797f service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4cf89ac7-2c5e-4b05-97b9-235754417573 req-02bb72c2-39f1-499e-aa02-8b774a65797f service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-4cf89ac7-2c5e-4b05-97b9-235754417573 req-02bb72c2-39f1-499e-aa02-8b774a65797f service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] No waiting events found dispatching network-vif-unplugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-4cf89ac7-2c5e-4b05-97b9-235754417573 req-02bb72c2-39f1-499e-aa02-8b774a65797f service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-vif-unplugged-5b396992-40d9-402a-8163-dbf99fb727bf for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:38 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:38 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7076MB free_disk=25.39160919189453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:38 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Instance destroyed successfully.
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.objects.instance [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lazy-loading 'resources' on Instance uuid 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-762095310',display_name='tempest-VolumesActionsTest-instance-762095310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-762095310',id=22,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a813ccd5a13f4ec689ef47b069c02448',ramdisk_id='',reservation_id='r-ev3al2xi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1245951475',owner_user_name='tempest-VolumesActionsTest-1245951475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:39:54Z,user_data=None,user_id='522c108f563c4c18a2054332549bc66a',uuid=23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converting VIF {"id": "5b396992-40d9-402a-8163-dbf99fb727bf", "address": "fa:16:3e:19:b3:a8", "network": {"id": "80f37cb5-f32a-4b31-bb10-8929927a3c99", "bridge": "br-int", "label": "tempest-VolumesActionsTest-917056357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813ccd5a13f4ec689ef47b069c02448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b396992-40", "ovs_interfaceid": "5b396992-40d9-402a-8163-dbf99fb727bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b3:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b396992-40d9-402a-8163-dbf99fb727bf,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b396992-40') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG os_vif [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b3:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b396992-40d9-402a-8163-dbf99fb727bf,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b396992-40') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b396992-40, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:38 user nova-compute[70869]: INFO os_vif [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b3:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b396992-40d9-402a-8163-dbf99fb727bf,network=Network(80f37cb5-f32a-4b31-bb10-8929927a3c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b396992-40')
Jul 25 15:41:38 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Deleting instance files /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9_del
Jul 25 15:41:38 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Deletion of /opt/stack/data/nova/instances/23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9_del complete
Jul 25 15:41:38 user nova-compute[70869]: INFO nova.compute.manager [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Took 1.33 seconds to destroy the instance on the hypervisor.
Jul 25 15:41:38 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Applying migration context for instance d384e3b6-8948-4db0-8d39-a340cb130c57 as it has an incoming, in-progress migration 94cc0e72-05b0-4894-894d-686ed1154513. Migration status is finished {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 15:41:38 user nova-compute[70869]: INFO nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating resource usage from migration 94cc0e72-05b0-4894-894d-686ed1154513
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance be3bdffd-27ff-49a8-9aef-ddf374f33752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bb780430-2cb6-4443-98ed-a224ec35bf57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e69fa561-b002-49d7-8251-3de03ae44940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Migration 94cc0e72-05b0-4894-894d-686ed1154513 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d384e3b6-8948-4db0-8d39-a340cb130c57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbVdSqlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:39 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:39 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:39 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb89e12-23e4-44ab-8a15-48154b415008]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:41:39 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.051s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[801466da-e895-41f2-a4f1-ebbe057ccf95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e] added
Jul 25 15:41:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.725s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aabe22-4b52-414c-9533-cf914d35c069]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d40c9cb-2536-4a2b-8276-f60cf86d9015]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbVdSqlB {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbVdSqlB" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc765c-781a-4601-84f2-087dbba2f570]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbVdSqlB'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c76059c-183f-456f-84e3-0cab3b574d8f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0811be8-8a49-487a-9dbe-b91e90a51ec7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75907c5-cb99-4464-af60-1633ccb99f58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e, portal: 172.16.0.220,3260]
Jul 25 15:41:39 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e, portal: 172.16.0.220,3260] successful.
Jul 25 15:41:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf2c58f-9273-4b17-8811-b20c4a57854e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba870f7-1053-4a3d-9a91-47993cfde398]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e (non-flash)
Jul 25 15:41:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:39 user nova-compute[70869]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e (non-flash)
Jul 25 15:41:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c031b30d-7e3e-4357-8b4d-a63e5fe4f713]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:41:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbVdSqlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:40 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Took 1.30 seconds to deallocate network for instance.
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-ddebffed-a588-4733-b947-e82dd7948b12 req-9cde6e1e-140e-4b94-be21-5a065bf7424b service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-vif-deleted-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] No waiting events found dispatching network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:40 user nova-compute[70869]: WARNING nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received unexpected event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf for instance with vm_state deleted and task_state None.
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] No waiting events found dispatching network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:40 user nova-compute[70869]: WARNING nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received unexpected event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf for instance with vm_state deleted and task_state None.
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] No waiting events found dispatching network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:40 user nova-compute[70869]: WARNING nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received unexpected event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf for instance with vm_state deleted and task_state None.
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Acquiring lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] No waiting events found dispatching network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:40 user nova-compute[70869]: WARNING nova.compute.manager [req-399a53f4-1c76-4640-a777-1902271739ae req-7ee0280f-4c33-43c3-a2ba-e5019790926a service nova] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Received unexpected event network-vif-plugged-5b396992-40d9-402a-8163-dbf99fb727bf for instance with vm_state deleted and task_state None.
Jul 25 15:41:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23134666631353164', 'path': '/dev/sdg'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134666631353164', 'path': '/dev/sdg'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.objects.instance [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lazy-loading 'flavor' on Instance uuid be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:40 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Deleted allocations for instance 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9
Jul 25 15:41:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:41:40 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:41:40 user nova-compute[70869]:   <source dev="/dev/sdg"/>
Jul 25 15:41:40 user nova-compute[70869]:   <target dev="vdc" bus="virtio"/>
Jul 25 15:41:40 user nova-compute[70869]:   <serial>d46da1f3-eab8-403e-94cf-2726b5b95f6e</serial>
Jul 25 15:41:40 user nova-compute[70869]: </disk>
Jul 25 15:41:40 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-694f62eb-faa2-404a-b074-28637a26d891 tempest-VolumesActionsTest-1245951475 tempest-VolumesActionsTest-1245951475-project-member] Lock "23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.366s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:40 user nova-compute[70869]: INFO nova.compute.manager [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Detaching volume f9fae374-9a46-4bb4-a6ea-75b14f062c16
Jul 25 15:41:41 user nova-compute[70869]: INFO nova.virt.block_device [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Attempting to driver detach volume f9fae374-9a46-4bb4-a6ea-75b14f062c16 from mountpoint /dev/vdb
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Attempting to detach device vdb from instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:41:41 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:41:41 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:41:41 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:41:41 user nova-compute[70869]:   <serial>f9fae374-9a46-4bb4-a6ea-75b14f062c16</serial>
Jul 25 15:41:41 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 15:41:41 user nova-compute[70869]: </disk>
Jul 25 15:41:41 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:41:41 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully detached device vdb from instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f from the persistent domain config.
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:41:41 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:41:41 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:41:41 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:41:41 user nova-compute[70869]:   <serial>f9fae374-9a46-4bb4-a6ea-75b14f062c16</serial>
Jul 25 15:41:41 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 15:41:41 user nova-compute[70869]: </disk>
Jul 25 15:41:41 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] No VIF found with MAC fa:16:3e:39:42:48, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-49ca8b0b-93d9-49b5-bc84-390cd01d318b tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.223s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299701.5929232, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:41:41 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully detached device vdb from instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f from the live domain config.
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwNZofUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:41 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1376adb8-e444-4540-a13f-fb0e93dff8c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:41:41 user nova-compute[70869]: No targets found.
Jul 25 15:41:41 user nova-compute[70869]: iSNS:
Jul 25 15:41:41 user nova-compute[70869]: No targets found.
Jul 25 15:41:41 user nova-compute[70869]: STATIC:
Jul 25 15:41:41 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16
Jul 25 15:41:41 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:41 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:41 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:41:41 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:41 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:41 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e
Jul 25 15:41:41 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:41 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:41 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:41:41 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:41 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:41 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10
Jul 25 15:41:41 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:41 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:41 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:41:41 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:41 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:41 user nova-compute[70869]: FIRMWARE:
Jul 25 15:41:41 user nova-compute[70869]: No targets found.
Jul 25 15:41:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:41:41 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:41:41 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e55d08c-4348-4d23-a5f8-45e987244362]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2692f49-308f-49fc-a305-718dfc8375a9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e (non-flash)
Jul 25 15:41:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:41 user nova-compute[70869]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e (non-flash)
Jul 25 15:41:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4343c6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2723a8d-21ad-4719-a174-989585a7d355]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0765dd7f-bdb7-4ddc-8c35-fffb196239b3]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9217dff5-fa3f-4bac-86df-f6ae33b4d8e4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf3c58e-b9d5-4139-bcf6-e76eadedba3f]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767aac1-415e-4208-812b-417605418bb1]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ec1520-159a-4fd0-a8b9-fa7edcacb358]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260]
Jul 25 15:41:41 user nova-compute[70869]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16, portal: 172.16.0.220,3260] successful.
Jul 25 15:41:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9fae374-9a46-4bb4-a6ea-75b14f062c16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[669a0da5-2f55-47f3-87ea-74de12a46467]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== disconnect_volume: return (383ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:41:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:42 user nova-compute[70869]: INFO nova.compute.manager [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Detaching volume d46da1f3-eab8-403e-94cf-2726b5b95f6e
Jul 25 15:41:42 user nova-compute[70869]: INFO nova.virt.block_device [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Attempting to driver detach volume d46da1f3-eab8-403e-94cf-2726b5b95f6e from mountpoint /dev/vdc
Jul 25 15:41:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Attempting to detach device vdc from instance be3bdffd-27ff-49a8-9aef-ddf374f33752 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:41:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:41:42 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:41:42 user nova-compute[70869]:   <source dev="/dev/sdg"/>
Jul 25 15:41:42 user nova-compute[70869]:   <target dev="vdc" bus="virtio"/>
Jul 25 15:41:42 user nova-compute[70869]:   <serial>d46da1f3-eab8-403e-94cf-2726b5b95f6e</serial>
Jul 25 15:41:42 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 15:41:42 user nova-compute[70869]: </disk>
Jul 25 15:41:42 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:41:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Successfully detached device vdc from instance be3bdffd-27ff-49a8-9aef-ddf374f33752 from the persistent domain config.
Jul 25 15:41:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance be3bdffd-27ff-49a8-9aef-ddf374f33752 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:41:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:41:42 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:41:42 user nova-compute[70869]:   <source dev="/dev/sdg"/>
Jul 25 15:41:42 user nova-compute[70869]:   <target dev="vdc" bus="virtio"/>
Jul 25 15:41:42 user nova-compute[70869]:   <serial>d46da1f3-eab8-403e-94cf-2726b5b95f6e</serial>
Jul 25 15:41:42 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 15:41:42 user nova-compute[70869]: </disk>
Jul 25 15:41:42 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:41:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299703.006088, be3bdffd-27ff-49a8-9aef-ddf374f33752 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:41:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Successfully detached device vdc from instance be3bdffd-27ff-49a8-9aef-ddf374f33752 from the live domain config.
Jul 25 15:41:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbVdSqlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:43 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7726541f-db83-4cfb-a26b-47b182e9e3af tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.071s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53339c2-d990-4ee5-8380-fcd89187c315]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:41:43 user nova-compute[70869]: No targets found.
Jul 25 15:41:43 user nova-compute[70869]: iSNS:
Jul 25 15:41:43 user nova-compute[70869]: No targets found.
Jul 25 15:41:43 user nova-compute[70869]: STATIC:
Jul 25 15:41:43 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:41:43 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:43 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:43 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e
Jul 25 15:41:43 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:43 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:43 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:41:43 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:43 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:43 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10
Jul 25 15:41:43 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:43 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:43 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:41:43 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:41:43 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:41:43 user nova-compute[70869]: FIRMWARE:
Jul 25 15:41:43 user nova-compute[70869]: No targets found.
Jul 25 15:41:43 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:41:43 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:41:43 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[57af56ca-fb73-43f0-b746-d5cc8c83df05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d878d34e-d39b-4d34-bf0b-41c375b56f0d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:43 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:43 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:43 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:43 user nova-compute[70869]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e (non-flash)
Jul 25 15:41:43 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:43 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:43 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:43 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:43 user nova-compute[70869]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e (non-flash)
Jul 25 15:41:43 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4341f9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e'): ({'sdg'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Removing single pathed devices sdg {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9332a4-28fc-4ce2-a014-6ba495462ccd]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16946f6-c631-4d5f-8e26-b8289d2f7c91]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Flushing IO for device /dev/sdg {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[382451c5-8fdf-4732-8057-0d3c3b485eaa]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fb0e91-ed64-456c-b488-3602fac1e1c7]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] SCSI volumes sdg have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6d6f8ca4-32be-477c-a571-c625ae57262f tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6d6f8ca4-32be-477c-a571-c625ae57262f tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6d6f8ca4-32be-477c-a571-c625ae57262f tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[217a2eeb-a3ba-4493-9a84-078f2212f466]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6d6f8ca4-32be-477c-a571-c625ae57262f tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70869) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6d6f8ca4-32be-477c-a571-c625ae57262f tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c174751-8f76-4d04-a085-4ee92b231856]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e, portal: 172.16.0.220,3260]
Jul 25 15:41:43 user nova-compute[70869]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e, portal: 172.16.0.220,3260] successful.
Jul 25 15:41:43 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46da1f3-eab8-403e-94cf-2726b5b95f6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.079s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f224a-42ce-425a-a77b-c23ee54c84aa]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] <== disconnect_volume: return (411ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-fe4d0686-9714-4673-a15b-a50582568123 req-4cbe87f5-39ee-4815-bf45-7f40aa2ace31 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-unplugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fe4d0686-9714-4673-a15b-a50582568123 req-4cbe87f5-39ee-4815-bf45-7f40aa2ace31 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fe4d0686-9714-4673-a15b-a50582568123 req-4cbe87f5-39ee-4815-bf45-7f40aa2ace31 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fe4d0686-9714-4673-a15b-a50582568123 req-4cbe87f5-39ee-4815-bf45-7f40aa2ace31 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-fe4d0686-9714-4673-a15b-a50582568123 req-4cbe87f5-39ee-4815-bf45-7f40aa2ace31 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-unplugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:43 user nova-compute[70869]: WARNING nova.compute.manager [req-fe4d0686-9714-4673-a15b-a50582568123 req-4cbe87f5-39ee-4815-bf45-7f40aa2ace31 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-unplugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state active and task_state powering-off.
Jul 25 15:41:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance destroyed successfully.
Jul 25 15:41:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6d6f8ca4-32be-477c-a571-c625ae57262f tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6d6f8ca4-32be-477c-a571-c625ae57262f tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.855s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:44 user nova-compute[70869]: DEBUG nova.objects.instance [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lazy-loading 'flavor' on Instance uuid be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-58d4bde3-e47a-4775-b48c-be61fc4cff95 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.850s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:41:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:44 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:41:44 user nova-compute[70869]: INFO nova.compute.claims [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Claim successful on node user
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.network.neutron [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:41:45 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.policy [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '713c16113e88444fb17474020846c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda092d639f48ae873b25823e3547fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:41:45 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Creating image(s)
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-f253e627-9fc3-4f56-a238-89cd09e39d0a req-73c8ff8a-559e-4718-8c28-85ac34cac5b5 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f253e627-9fc3-4f56-a238-89cd09e39d0a req-73c8ff8a-559e-4718-8c28-85ac34cac5b5 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f253e627-9fc3-4f56-a238-89cd09e39d0a req-73c8ff8a-559e-4718-8c28-85ac34cac5b5 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f253e627-9fc3-4f56-a238-89cd09e39d0a req-73c8ff8a-559e-4718-8c28-85ac34cac5b5 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-f253e627-9fc3-4f56-a238-89cd09e39d0a req-73c8ff8a-559e-4718-8c28-85ac34cac5b5 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:45 user nova-compute[70869]: WARNING nova.compute.manager [req-f253e627-9fc3-4f56-a238-89cd09e39d0a req-73c8ff8a-559e-4718-8c28-85ac34cac5b5 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state stopped and task_state None.
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk 1073741824" returned: 0 in 0.060s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.164s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:46 user nova-compute[70869]: INFO nova.compute.manager [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Unshelving
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Cannot resize image /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'migration_context' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Ensure instance console log exists: /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:46 user nova-compute[70869]: INFO nova.virt.block_device [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Booting with volume abd3a4fb-7d3b-4cbc-a399-8aa59081943a at /dev/vda
Jul 25 15:41:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Successfully created port: dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG os_brick.utils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[176f3e3f-2d62-416e-982f-971e2153369f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[26277921-78f8-4bdc-b716-5e426526cf12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e795270-a004-430c-91db-d9c939cfa2f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aca494-e484-4f25-96a1-39b4a82a254a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:41:46 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:41:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b09bcbf-2424-41fd-9a19-fb1260a34b5a]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG os_brick.utils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:46 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating existing volume attachment record: 829c41c6-5677-4b6d-a913-17459e40fade {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Successfully updated port: dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquired lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-3564577b-e0ac-4582-9d31-0eb5ccd4f7f0 req-d58009d5-8e8e-415b-bbab-33fe37752b53 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-changed-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-3564577b-e0ac-4582-9d31-0eb5ccd4f7f0 req-d58009d5-8e8e-415b-bbab-33fe37752b53 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Refreshing instance network info cache due to event network-changed-dc8120e3-6fb4-438a-94a3-7cbb36406ebd. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3564577b-e0ac-4582-9d31-0eb5ccd4f7f0 req-d58009d5-8e8e-415b-bbab-33fe37752b53 service nova] Acquiring lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating instance_info_cache with network_info: [{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Releasing lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance network_info: |[{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3564577b-e0ac-4582-9d31-0eb5ccd4f7f0 req-d58009d5-8e8e-415b-bbab-33fe37752b53 service nova] Acquired lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.network.neutron [req-3564577b-e0ac-4582-9d31-0eb5ccd4f7f0 req-d58009d5-8e8e-415b-bbab-33fe37752b53 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Refreshing network info cache for port dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Start _get_guest_xml network_info=[{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:41:47 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:47 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130419921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130419921',id=27,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBibbEANFpipugLVFSsyYgF7Xx6RRXls3oAwTaoxYPberG6kOOsbNUG8bY+SxGCe3UQ/4Me+ZJgD39OBGA19dXjFi/9teyY6MK62PbcwCIEvg5E2zAdMNXFkGMs5GUse8Q==',key_name='tempest-keypair-529975062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-qvjhymog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=bba84347-9d28-4789-8d45-3e39770c8f4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'pci_devices' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:41:47 user nova-compute[70869]:   <uuid>bba84347-9d28-4789-8d45-3e39770c8f4f</uuid>
Jul 25 15:41:47 user nova-compute[70869]:   <name>instance-0000001b</name>
Jul 25 15:41:47 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:41:47 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:41:47 user nova-compute[70869]:   <metadata>
Jul 25 15:41:47 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:41:47 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:41:47 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2130419921</nova:name>
Jul 25 15:41:47 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:41:47</nova:creationTime>
Jul 25 15:41:47 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:41:47 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:41:47 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:41:47 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:41:47 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:41:47 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:41:47 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:41:47 user nova-compute[70869]:       <nova:owner>
Jul 25 15:41:47 user nova-compute[70869]:         <nova:user uuid="713c16113e88444fb17474020846c914">tempest-AttachVolumeShelveTestJSON-1783080081-project-member</nova:user>
Jul 25 15:41:47 user nova-compute[70869]:         <nova:project uuid="fbda092d639f48ae873b25823e3547fe">tempest-AttachVolumeShelveTestJSON-1783080081</nova:project>
Jul 25 15:41:47 user nova-compute[70869]:       </nova:owner>
Jul 25 15:41:47 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:41:47 user nova-compute[70869]:       <nova:ports>
Jul 25 15:41:47 user nova-compute[70869]:         <nova:port uuid="dc8120e3-6fb4-438a-94a3-7cbb36406ebd">
Jul 25 15:41:47 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:41:47 user nova-compute[70869]:         </nova:port>
Jul 25 15:41:47 user nova-compute[70869]:       </nova:ports>
Jul 25 15:41:47 user nova-compute[70869]:     </nova:instance>
Jul 25 15:41:47 user nova-compute[70869]:   </metadata>
Jul 25 15:41:47 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:41:47 user nova-compute[70869]:     <system>
Jul 25 15:41:47 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:41:47 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:41:47 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:41:47 user nova-compute[70869]:       <entry name="serial">bba84347-9d28-4789-8d45-3e39770c8f4f</entry>
Jul 25 15:41:47 user nova-compute[70869]:       <entry name="uuid">bba84347-9d28-4789-8d45-3e39770c8f4f</entry>
Jul 25 15:41:47 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:41:47 user nova-compute[70869]:     </system>
Jul 25 15:41:47 user nova-compute[70869]:   </sysinfo>
Jul 25 15:41:47 user nova-compute[70869]:   <os>
Jul 25 15:41:47 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:41:47 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:41:47 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:41:47 user nova-compute[70869]:   </os>
Jul 25 15:41:47 user nova-compute[70869]:   <features>
Jul 25 15:41:47 user nova-compute[70869]:     <acpi/>
Jul 25 15:41:47 user nova-compute[70869]:     <apic/>
Jul 25 15:41:47 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:41:47 user nova-compute[70869]:   </features>
Jul 25 15:41:47 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:41:47 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:41:47 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:41:47 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:41:47 user nova-compute[70869]:   </clock>
Jul 25 15:41:47 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:41:47 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:41:47 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:41:47 user nova-compute[70869]:   </cpu>
Jul 25 15:41:47 user nova-compute[70869]:   <devices>
Jul 25 15:41:47 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:41:47 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:41:47 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk"/>
Jul 25 15:41:47 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:41:47 user nova-compute[70869]:     </disk>
Jul 25 15:41:47 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:41:47 user nova-compute[70869]:       <mac address="fa:16:3e:37:40:c9"/>
Jul 25 15:41:47 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:41:47 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:41:47 user nova-compute[70869]:       <target dev="tapdc8120e3-6f"/>
Jul 25 15:41:47 user nova-compute[70869]:     </interface>
Jul 25 15:41:47 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:41:47 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/console.log" append="off"/>
Jul 25 15:41:47 user nova-compute[70869]:     </serial>
Jul 25 15:41:47 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:41:47 user nova-compute[70869]:     <video>
Jul 25 15:41:47 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:41:47 user nova-compute[70869]:     </video>
Jul 25 15:41:47 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:41:47 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:41:47 user nova-compute[70869]:     </rng>
Jul 25 15:41:47 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:41:47 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:41:47 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:41:47 user nova-compute[70869]:     </memballoon>
Jul 25 15:41:47 user nova-compute[70869]:   </devices>
Jul 25 15:41:47 user nova-compute[70869]: </domain>
Jul 25 15:41:47 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130419921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130419921',id=27,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBibbEANFpipugLVFSsyYgF7Xx6RRXls3oAwTaoxYPberG6kOOsbNUG8bY+SxGCe3UQ/4Me+ZJgD39OBGA19dXjFi/9teyY6MK62PbcwCIEvg5E2zAdMNXFkGMs5GUse8Q==',key_name='tempest-keypair-529975062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-qvjhymog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=bba84347-9d28-4789-8d45-3e39770c8f4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG os_vif [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc8120e3-6f, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc8120e3-6f, col_values=(('external_ids', {'iface-id': 'dc8120e3-6fb4-438a-94a3-7cbb36406ebd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:40:c9', 'vm-uuid': 'bba84347-9d28-4789-8d45-3e39770c8f4f'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:47 user nova-compute[70869]: INFO os_vif [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f')
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] No VIF found with MAC fa:16:3e:37:40:c9, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:41:48 user nova-compute[70869]: DEBUG nova.network.neutron [req-3564577b-e0ac-4582-9d31-0eb5ccd4f7f0 req-d58009d5-8e8e-415b-bbab-33fe37752b53 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updated VIF entry in instance network info cache for port dc8120e3-6fb4-438a-94a3-7cbb36406ebd. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:41:48 user nova-compute[70869]: DEBUG nova.network.neutron [req-3564577b-e0ac-4582-9d31-0eb5ccd4f7f0 req-d58009d5-8e8e-415b-bbab-33fe37752b53 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating instance_info_cache with network_info: [{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3564577b-e0ac-4582-9d31-0eb5ccd4f7f0 req-d58009d5-8e8e-415b-bbab-33fe37752b53 service nova] Releasing lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e8cb95c-2beb-4924-b16d-8e3bec4cbf6a req-8a930beb-a4e1-47a6-801a-c327321d2e62 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e8cb95c-2beb-4924-b16d-8e3bec4cbf6a req-8a930beb-a4e1-47a6-801a-c327321d2e62 service nova] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e8cb95c-2beb-4924-b16d-8e3bec4cbf6a req-8a930beb-a4e1-47a6-801a-c327321d2e62 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e8cb95c-2beb-4924-b16d-8e3bec4cbf6a req-8a930beb-a4e1-47a6-801a-c327321d2e62 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e8cb95c-2beb-4924-b16d-8e3bec4cbf6a req-8a930beb-a4e1-47a6-801a-c327321d2e62 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] No waiting events found dispatching network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:49 user nova-compute[70869]: WARNING nova.compute.manager [req-0e8cb95c-2beb-4924-b16d-8e3bec4cbf6a req-8a930beb-a4e1-47a6-801a-c327321d2e62 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received unexpected event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd for instance with vm_state building and task_state spawning.
Jul 25 15:41:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299711.1882389, bba84347-9d28-4789-8d45-3e39770c8f4f => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:41:51 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] VM Resumed (Lifecycle Event)
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:41:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance spawned successfully.
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:41:51 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299711.1898723, bba84347-9d28-4789-8d45-3e39770c8f4f => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:41:51 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] VM Started (Lifecycle Event)
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:41:51 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:41:51 user nova-compute[70869]: INFO nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Took 5.82 seconds to spawn the instance on the hypervisor.
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-3e990862-6c4b-4bdf-a595-ad5b1ffd213e req-9decb869-c71e-4ce6-b0e8-fec7f0f50a6a service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3e990862-6c4b-4bdf-a595-ad5b1ffd213e req-9decb869-c71e-4ce6-b0e8-fec7f0f50a6a service nova] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3e990862-6c4b-4bdf-a595-ad5b1ffd213e req-9decb869-c71e-4ce6-b0e8-fec7f0f50a6a service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3e990862-6c4b-4bdf-a595-ad5b1ffd213e req-9decb869-c71e-4ce6-b0e8-fec7f0f50a6a service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-3e990862-6c4b-4bdf-a595-ad5b1ffd213e req-9decb869-c71e-4ce6-b0e8-fec7f0f50a6a service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] No waiting events found dispatching network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:51 user nova-compute[70869]: WARNING nova.compute.manager [req-3e990862-6c4b-4bdf-a595-ad5b1ffd213e req-9decb869-c71e-4ce6-b0e8-fec7f0f50a6a service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received unexpected event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd for instance with vm_state building and task_state spawning.
Jul 25 15:41:51 user nova-compute[70869]: INFO nova.compute.manager [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Took 6.76 seconds to build instance.
Jul 25 15:41:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18ab66b1-6993-4613-90fd-6070ec168a15 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.878s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lazy-loading 'pci_requests' on Instance uuid 4d9706b8-2a69-4272-89d3-f8a985e0ad2c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d9706b8-2a69-4272-89d3-f8a985e0ad2c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:41:53 user nova-compute[70869]: INFO nova.compute.claims [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Claim successful on node user
Jul 25 15:41:53 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299698.1969001, 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:41:53 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] VM Stopped (Lifecycle Event)
Jul 25 15:41:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b31c0c92-9b28-49aa-b031-44929e1de02f None None] [instance: 23f2c0c7-3865-4f3d-a797-f3ffaa01ebc9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:54 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:41:54 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:41:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:54 user nova-compute[70869]: INFO nova.network.neutron [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating port 685fa69b-6fa0-4620-8367-c7363215995c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 25 15:41:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquired lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-838cd4aa-eead-458d-ad8e-28ccf848644f req-da972045-f0de-4e89-a691-7ca357a4acc6 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-changed-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-838cd4aa-eead-458d-ad8e-28ccf848644f req-da972045-f0de-4e89-a691-7ca357a4acc6 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing instance network info cache due to event network-changed-685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-838cd4aa-eead-458d-ad8e-28ccf848644f req-da972045-f0de-4e89-a691-7ca357a4acc6 service nova] Acquiring lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.network.neutron [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating instance_info_cache with network_info: [{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Releasing lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:41:55 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Creating image(s)
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Ensure instance console log exists: /opt/stack/data/nova/instances/4d9706b8-2a69-4272-89d3-f8a985e0ad2c/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Start _get_guest_xml network_info=[{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '829c41c6-5677-4b6d-a913-17459e40fade', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNljCLFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d9706b8-2a69-4272-89d3-f8a985e0ad2c', 'attached_at': '', 'detached_at': '', 'volume_id': 'abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'serial': 'abd3a4fb-7d3b-4cbc-a399-8aa59081943a'}, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-838cd4aa-eead-458d-ad8e-28ccf848644f req-da972045-f0de-4e89-a691-7ca357a4acc6 service nova] Acquired lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.network.neutron [req-838cd4aa-eead-458d-ad8e-28ccf848644f req-da972045-f0de-4e89-a691-7ca357a4acc6 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:41:55 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:55 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d9706b8-2a69-4272-89d3-f8a985e0ad2c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNljCLFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:41:55 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:55 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:41:55 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab2810c-d3f2-4778-87d9-c5dc36f44822]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:41:55 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c672423-e2f0-41c0-afc3-2e1ba27a163e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a] added
Jul 25 15:41:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[95deee61-0930-4a09-917c-e28ab3eee0bd]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f661b5-d44e-4fd2-aa3f-6170ee1c1ec8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SNljCLFi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SNljCLFi" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e562f4c8-f630-4c1d-8a06-918b4a592241]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SNljCLFi'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21f98e9-5673-44e7-97e4-2f534b444cf6]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cb262c-f4b7-4c0d-b9e0-f78b7f0ed0a3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[724f6315-8f89-496a-baf3-64952805bb23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260]
Jul 25 15:41:55 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260] successful.
Jul 25 15:41:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aa2b81-5881-461f-a07e-0f06fa8ac365]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d99d194-52d0-480e-96e4-a54826163c67]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:41:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:41:55 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:41:55 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24be17b9-1419-4360-98e3-01425474ad1c]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:41:55 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNljCLFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:41:56 user nova-compute[70869]: DEBUG nova.network.neutron [req-838cd4aa-eead-458d-ad8e-28ccf848644f req-da972045-f0de-4e89-a691-7ca357a4acc6 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updated VIF entry in instance network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:41:56 user nova-compute[70869]: DEBUG nova.network.neutron [req-838cd4aa-eead-458d-ad8e-28ccf848644f req-da972045-f0de-4e89-a691-7ca357a4acc6 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating instance_info_cache with network_info: [{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:41:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-838cd4aa-eead-458d-ad8e-28ccf848644f req-da972045-f0de-4e89-a691-7ca357a4acc6 service nova] Releasing lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23035393835313064', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035393835313064', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1120590963',display_name='tempest-TestShelveInstance-server-1120590963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1120590963',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1341964134',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:38:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='77781f71b0364014b1561b8158656565',ramdisk_id='',reservation_id='r-ax0saf22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2115421608',owner_user_name='tempest-TestShelveInstance-2115421608-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:41:46Z,user_data=None,user_id='6af1342ac93849d995a457cde23bde41',uuid=4d9706b8-2a69-4272-89d3-f8a985e0ad2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converting VIF {"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d9706b8-2a69-4272-89d3-f8a985e0ad2c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:41:57 user nova-compute[70869]:   <uuid>4d9706b8-2a69-4272-89d3-f8a985e0ad2c</uuid>
Jul 25 15:41:57 user nova-compute[70869]:   <name>instance-00000014</name>
Jul 25 15:41:57 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:41:57 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:41:57 user nova-compute[70869]:   <metadata>
Jul 25 15:41:57 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:41:57 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:41:57 user nova-compute[70869]:       <nova:name>tempest-TestShelveInstance-server-1120590963</nova:name>
Jul 25 15:41:57 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:41:55</nova:creationTime>
Jul 25 15:41:57 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:41:57 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:41:57 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:41:57 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:41:57 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:41:57 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:41:57 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:41:57 user nova-compute[70869]:       <nova:owner>
Jul 25 15:41:57 user nova-compute[70869]:         <nova:user uuid="6af1342ac93849d995a457cde23bde41">tempest-TestShelveInstance-2115421608-project-member</nova:user>
Jul 25 15:41:57 user nova-compute[70869]:         <nova:project uuid="77781f71b0364014b1561b8158656565">tempest-TestShelveInstance-2115421608</nova:project>
Jul 25 15:41:57 user nova-compute[70869]:       </nova:owner>
Jul 25 15:41:57 user nova-compute[70869]:       <nova:ports>
Jul 25 15:41:57 user nova-compute[70869]:         <nova:port uuid="685fa69b-6fa0-4620-8367-c7363215995c">
Jul 25 15:41:57 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 15:41:57 user nova-compute[70869]:         </nova:port>
Jul 25 15:41:57 user nova-compute[70869]:       </nova:ports>
Jul 25 15:41:57 user nova-compute[70869]:     </nova:instance>
Jul 25 15:41:57 user nova-compute[70869]:   </metadata>
Jul 25 15:41:57 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:41:57 user nova-compute[70869]:     <system>
Jul 25 15:41:57 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:41:57 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:41:57 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:41:57 user nova-compute[70869]:       <entry name="serial">4d9706b8-2a69-4272-89d3-f8a985e0ad2c</entry>
Jul 25 15:41:57 user nova-compute[70869]:       <entry name="uuid">4d9706b8-2a69-4272-89d3-f8a985e0ad2c</entry>
Jul 25 15:41:57 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:41:57 user nova-compute[70869]:     </system>
Jul 25 15:41:57 user nova-compute[70869]:   </sysinfo>
Jul 25 15:41:57 user nova-compute[70869]:   <os>
Jul 25 15:41:57 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:41:57 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:41:57 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:41:57 user nova-compute[70869]:   </os>
Jul 25 15:41:57 user nova-compute[70869]:   <features>
Jul 25 15:41:57 user nova-compute[70869]:     <acpi/>
Jul 25 15:41:57 user nova-compute[70869]:     <apic/>
Jul 25 15:41:57 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:41:57 user nova-compute[70869]:   </features>
Jul 25 15:41:57 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:41:57 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:41:57 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:41:57 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:41:57 user nova-compute[70869]:   </clock>
Jul 25 15:41:57 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:41:57 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:41:57 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:41:57 user nova-compute[70869]:   </cpu>
Jul 25 15:41:57 user nova-compute[70869]:   <devices>
Jul 25 15:41:57 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:41:57 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:41:57 user nova-compute[70869]:       <source dev="/dev/sdc"/>
Jul 25 15:41:57 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:41:57 user nova-compute[70869]:       <serial>abd3a4fb-7d3b-4cbc-a399-8aa59081943a</serial>
Jul 25 15:41:57 user nova-compute[70869]:     </disk>
Jul 25 15:41:57 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:41:57 user nova-compute[70869]:       <mac address="fa:16:3e:5a:61:d5"/>
Jul 25 15:41:57 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:41:57 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:41:57 user nova-compute[70869]:       <target dev="tap685fa69b-6f"/>
Jul 25 15:41:57 user nova-compute[70869]:     </interface>
Jul 25 15:41:57 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:41:57 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/4d9706b8-2a69-4272-89d3-f8a985e0ad2c/console.log" append="off"/>
Jul 25 15:41:57 user nova-compute[70869]:     </serial>
Jul 25 15:41:57 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:41:57 user nova-compute[70869]:     <video>
Jul 25 15:41:57 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:41:57 user nova-compute[70869]:     </video>
Jul 25 15:41:57 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:41:57 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:41:57 user nova-compute[70869]:     </rng>
Jul 25 15:41:57 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:41:57 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:41:57 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:41:57 user nova-compute[70869]:     </memballoon>
Jul 25 15:41:57 user nova-compute[70869]:   </devices>
Jul 25 15:41:57 user nova-compute[70869]: </domain>
Jul 25 15:41:57 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1120590963',display_name='tempest-TestShelveInstance-server-1120590963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1120590963',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1341964134',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:38:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='77781f71b0364014b1561b8158656565',ramdisk_id='',reservation_id='r-ax0saf22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2115421608',owner_user_name='tempest-TestShelveInstance-2115421608-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:41:46Z,user_data=None,user_id='6af1342ac93849d995a457cde23bde41',uuid=4d9706b8-2a69-4272-89d3-f8a985e0ad2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converting VIF {"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG os_vif [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap685fa69b-6f, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap685fa69b-6f, col_values=(('external_ids', {'iface-id': '685fa69b-6fa0-4620-8367-c7363215995c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:61:d5', 'vm-uuid': '4d9706b8-2a69-4272-89d3-f8a985e0ad2c'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:57 user nova-compute[70869]: INFO os_vif [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f')
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:41:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] No VIF found with MAC fa:16:3e:5a:61:d5, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:41:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-5de0bfb2-c160-40e7-9d63-5a0ffbd8117a req-8f8cae75-6988-43a4-b0e4-e48fecd28fe2 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:41:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5de0bfb2-c160-40e7-9d63-5a0ffbd8117a req-8f8cae75-6988-43a4-b0e4-e48fecd28fe2 service nova] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:41:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5de0bfb2-c160-40e7-9d63-5a0ffbd8117a req-8f8cae75-6988-43a4-b0e4-e48fecd28fe2 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:41:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5de0bfb2-c160-40e7-9d63-5a0ffbd8117a req-8f8cae75-6988-43a4-b0e4-e48fecd28fe2 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:41:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-5de0bfb2-c160-40e7-9d63-5a0ffbd8117a req-8f8cae75-6988-43a4-b0e4-e48fecd28fe2 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] No waiting events found dispatching network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:41:58 user nova-compute[70869]: WARNING nova.compute.manager [req-5de0bfb2-c160-40e7-9d63-5a0ffbd8117a req-8f8cae75-6988-43a4-b0e4-e48fecd28fe2 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received unexpected event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 15:41:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:59 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299704.0582666, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:41:59 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] VM Stopped (Lifecycle Event)
Jul 25 15:41:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d24e0c58-1948-4c4b-a7a9-ba28d1f7c49f None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:41:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d24e0c58-1948-4c4b-a7a9-ba28d1f7c49f None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:41:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:41:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299720.7480304, 4d9706b8-2a69-4272-89d3-f8a985e0ad2c => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:42:00 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] VM Resumed (Lifecycle Event)
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:42:00 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Instance spawned successfully.
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-d1a36c94-37d8-4372-a015-24ff75b0e98d req-eeefbd0a-89e9-4f49-a9a6-df477820e07a service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d1a36c94-37d8-4372-a015-24ff75b0e98d req-eeefbd0a-89e9-4f49-a9a6-df477820e07a service nova] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d1a36c94-37d8-4372-a015-24ff75b0e98d req-eeefbd0a-89e9-4f49-a9a6-df477820e07a service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d1a36c94-37d8-4372-a015-24ff75b0e98d req-eeefbd0a-89e9-4f49-a9a6-df477820e07a service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-d1a36c94-37d8-4372-a015-24ff75b0e98d req-eeefbd0a-89e9-4f49-a9a6-df477820e07a service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] No waiting events found dispatching network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:42:00 user nova-compute[70869]: WARNING nova.compute.manager [req-d1a36c94-37d8-4372-a015-24ff75b0e98d req-eeefbd0a-89e9-4f49-a9a6-df477820e07a service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received unexpected event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:42:00 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299720.7495458, 4d9706b8-2a69-4272-89d3-f8a985e0ad2c => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:42:00 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] VM Started (Lifecycle Event)
Jul 25 15:42:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3847e310-7072-49ca-aa4c-8ca50635996a tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.697s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:42:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:42:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:09 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:42:09 user nova-compute[70869]: INFO nova.compute.manager [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] instance snapshotting
Jul 25 15:42:09 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Beginning live snapshot process
Jul 25 15:42:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json -f qcow2 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json -f qcow2 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json -f qcow2" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpumnv9bw5/0f8d2edd845b4b94b418ca64cbd60670.delta 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpumnv9bw5/0f8d2edd845b4b94b418ca64cbd60670.delta 1073741824" returned: 0 in 0.053s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 15:42:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:42:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:42:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 15:42:11 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:42:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpumnv9bw5/0f8d2edd845b4b94b418ca64cbd60670.delta /opt/stack/data/nova/instances/snapshots/tmpumnv9bw5/0f8d2edd845b4b94b418ca64cbd60670 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpumnv9bw5/0f8d2edd845b4b94b418ca64cbd60670.delta /opt/stack/data/nova/instances/snapshots/tmpumnv9bw5/0f8d2edd845b4b94b418ca64cbd60670" returned: 0 in 0.283s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Snapshot extracted, beginning image upload
Jul 25 15:42:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:14 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Snapshot image upload complete
Jul 25 15:42:14 user nova-compute[70869]: INFO nova.compute.manager [None req-1160009d-f375-4e47-861a-2581ed4776d4 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Took 5.41 seconds to snapshot the instance on the hypervisor.
Jul 25 15:42:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-cf182464-e523-43de-8ce2-573a768a2911 req-9fdef71d-63a8-48ce-a19b-4224d0bca0b8 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received event network-changed-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:42:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-cf182464-e523-43de-8ce2-573a768a2911 req-9fdef71d-63a8-48ce-a19b-4224d0bca0b8 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Refreshing instance network info cache due to event network-changed-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:42:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cf182464-e523-43de-8ce2-573a768a2911 req-9fdef71d-63a8-48ce-a19b-4224d0bca0b8 service nova] Acquiring lock "refresh_cache-bb780430-2cb6-4443-98ed-a224ec35bf57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:42:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cf182464-e523-43de-8ce2-573a768a2911 req-9fdef71d-63a8-48ce-a19b-4224d0bca0b8 service nova] Acquired lock "refresh_cache-bb780430-2cb6-4443-98ed-a224ec35bf57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:42:22 user nova-compute[70869]: DEBUG nova.network.neutron [req-cf182464-e523-43de-8ce2-573a768a2911 req-9fdef71d-63a8-48ce-a19b-4224d0bca0b8 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Refreshing network info cache for port 3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:42:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-cf182464-e523-43de-8ce2-573a768a2911 req-9fdef71d-63a8-48ce-a19b-4224d0bca0b8 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Updated VIF entry in instance network info cache for port 3bb2f13a-02b4-4872-8b2c-dfb23be94ba1. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:42:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-cf182464-e523-43de-8ce2-573a768a2911 req-9fdef71d-63a8-48ce-a19b-4224d0bca0b8 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Updating instance_info_cache with network_info: [{"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:42:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cf182464-e523-43de-8ce2-573a768a2911 req-9fdef71d-63a8-48ce-a19b-4224d0bca0b8 service nova] Releasing lock "refresh_cache-bb780430-2cb6-4443-98ed-a224ec35bf57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:42:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:25 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lazy-loading 'flavor' on Instance uuid bb780430-2cb6-4443-98ed-a224ec35bf57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:42:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:26 user nova-compute[70869]: INFO nova.compute.manager [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Attaching volume b79faee5-388f-4ad0-ac51-e349ce7e7e32 to /dev/vdb
Jul 25 15:42:26 user nova-compute[70869]: DEBUG os_brick.utils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba61d291-a356-4294-ad24-696f0ded2db3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd712b6d-c851-441c-a547-d0b1e65c5d7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3233c93-70cb-423d-ae83-a44e7e530462]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[947d3001-1b98-48ba-acd7-1b1be1ee1703]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:42:26 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bcc5a5-ea2d-489b-8e90-ab645d2cc30b]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG os_brick.utils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Updating existing volume attachment record: bf140568-a84d-4ece-aef6-1dc710f35083 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances with incomplete migration  {{(pid=70869) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 15:42:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:32 user nova-compute[70869]: INFO nova.compute.manager [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Detaching volume 6570846b-51a6-492d-9176-94a72d635c10
Jul 25 15:42:33 user nova-compute[70869]: INFO nova.virt.block_device [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Attempting to driver detach volume 6570846b-51a6-492d-9176-94a72d635c10 from mountpoint /dev/vdb
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Attempting to detach device vdb from instance be3bdffd-27ff-49a8-9aef-ddf374f33752 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:42:33 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:42:33 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:42:33 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:42:33 user nova-compute[70869]:   <serial>6570846b-51a6-492d-9176-94a72d635c10</serial>
Jul 25 15:42:33 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:42:33 user nova-compute[70869]: </disk>
Jul 25 15:42:33 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:42:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Successfully detached device vdb from instance be3bdffd-27ff-49a8-9aef-ddf374f33752 from the persistent domain config.
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be3bdffd-27ff-49a8-9aef-ddf374f33752 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:42:33 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:42:33 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:42:33 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:42:33 user nova-compute[70869]:   <serial>6570846b-51a6-492d-9176-94a72d635c10</serial>
Jul 25 15:42:33 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:42:33 user nova-compute[70869]: </disk>
Jul 25 15:42:33 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299753.518373, be3bdffd-27ff-49a8-9aef-ddf374f33752 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:42:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Successfully detached device vdb from instance be3bdffd-27ff-49a8-9aef-ddf374f33752 from the live domain config.
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jESQuwBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:42:33 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f2d704-0e79-4685-8e01-3fc0ce14ce9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:42:33 user nova-compute[70869]: No targets found.
Jul 25 15:42:33 user nova-compute[70869]: iSNS:
Jul 25 15:42:33 user nova-compute[70869]: No targets found.
Jul 25 15:42:33 user nova-compute[70869]: STATIC:
Jul 25 15:42:33 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:42:33 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:33 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:33 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:42:33 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:33 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:33 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10
Jul 25 15:42:33 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:33 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:33 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:42:33 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:33 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:33 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:42:33 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:33 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:33 user nova-compute[70869]: FIRMWARE:
Jul 25 15:42:33 user nova-compute[70869]: No targets found.
Jul 25 15:42:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:42:33 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:42:33 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBfAsobY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:42:33 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fb0cb3-87cd-40f1-8f11-42e78b4e7c20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fef035-74c7-4995-bd49-00a2f6a3c97e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:33 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:33 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:42:33 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:33 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:33 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:33 user nova-compute[70869]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 (non-flash)
Jul 25 15:42:33 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:33 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c37bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e61b13-b51f-4365-89d7-120466cdbb18]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[959d8d18-c2a7-4446-8a3b-582f3d3a272d]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c640bfaf-9043-4421-874c-81526c963a5e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ec9d2f-2fb5-48f9-a9b1-19900b9b3e77]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[918fe5f0-22a6-4c52-a2c1-0527f076612f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ebe465-555a-4820-b037-d026dcde1ebc]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10, portal: 172.16.0.220,3260]
Jul 25 15:42:33 user nova-compute[70869]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10, portal: 172.16.0.220,3260] successful.
Jul 25 15:42:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6570846b-51a6-492d-9176-94a72d635c10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6c72d7-9dde-4300-95f7-809cd8c20d6f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] <== disconnect_volume: return (326ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.303s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:42:33 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:42:33 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d976ceb4-89df-4ee0-a072-5fb4ef97a134]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:42:33 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[da868102-0206-4f08-8178-b6a97170440c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32] added
Jul 25 15:42:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d487caa4-1d1a-4fca-af05-31b087e8269e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5181fd-3774-49fe-ad3d-ae92b982e0b9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBfAsobY {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBfAsobY" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d72cb8-4233-4d7f-8d24-ff0d41dd0035]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBfAsobY'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1ae774-1321-4706-b94a-a5ed6b84c68e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[74276593-d6b6-41a6-990d-3262859c51b4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd550a1-e3a3-4349-b3c5-dc8adc2bac08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32, portal: 172.16.0.220,3260]
Jul 25 15:42:34 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32, portal: 172.16.0.220,3260] successful.
Jul 25 15:42:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[729fe0df-3457-4724-853d-27383cf3915e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9963b73d-8428-40d4-9fe8-913937e317e4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:34 user nova-compute[70869]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 (non-flash)
Jul 25 15:42:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[939aec29-7c01-4f42-b3d5-92e0ef929521]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBfAsobY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updating instance_info_cache with network_info: [{"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-192075a1-d218-49e3-a1ed-9b3f8b46c36a req-b1fdba11-5b48-4b6a-a485-7c53c44f1e61 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-changed-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-192075a1-d218-49e3-a1ed-9b3f8b46c36a req-b1fdba11-5b48-4b6a-a485-7c53c44f1e61 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Refreshing instance network info cache due to event network-changed-b7d31348-a01c-40f7-993c-e350d788f767. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-192075a1-d218-49e3-a1ed-9b3f8b46c36a req-b1fdba11-5b48-4b6a-a485-7c53c44f1e61 service nova] Acquiring lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-192075a1-d218-49e3-a1ed-9b3f8b46c36a req-b1fdba11-5b48-4b6a-a485-7c53c44f1e61 service nova] Acquired lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.network.neutron [req-192075a1-d218-49e3-a1ed-9b3f8b46c36a req-b1fdba11-5b48-4b6a-a485-7c53c44f1e61 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Refreshing network info cache for port b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] <== connect_volume: return (1694ms) {'type': 'block', 'scsi_wwn': '26262373732363930', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262373732363930', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lazy-loading 'flavor' on Instance uuid bb780430-2cb6-4443-98ed-a224ec35bf57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:42:35 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:42:35 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:42:35 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:42:35 user nova-compute[70869]:   <serial>b79faee5-388f-4ad0-ac51-e349ce7e7e32</serial>
Jul 25 15:42:35 user nova-compute[70869]: </disk>
Jul 25 15:42:35 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.network.neutron [req-192075a1-d218-49e3-a1ed-9b3f8b46c36a req-b1fdba11-5b48-4b6a-a485-7c53c44f1e61 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updated VIF entry in instance network info cache for port b7d31348-a01c-40f7-993c-e350d788f767. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.network.neutron [req-192075a1-d218-49e3-a1ed-9b3f8b46c36a req-b1fdba11-5b48-4b6a-a485-7c53c44f1e61 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating instance_info_cache with network_info: [{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-192075a1-d218-49e3-a1ed-9b3f8b46c36a req-b1fdba11-5b48-4b6a-a485-7c53c44f1e61 service nova] Releasing lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] No VIF found with MAC fa:16:3e:4d:b5:bd, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:42:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e8b0d93e-4cef-4cea-a594-b9d84e497190 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.763s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:36 user nova-compute[70869]: DEBUG nova.compute.manager [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Stashing vm_state: active {{(pid=70869) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 25 15:42:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'pci_requests' on Instance uuid bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:42:36 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:42:36 user nova-compute[70869]: INFO nova.compute.claims [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Claim successful on node user
Jul 25 15:42:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'resources' on Instance uuid bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:42:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'pci_devices' on Instance uuid bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:42:36 user nova-compute[70869]: INFO nova.compute.resource_tracker [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating resource usage from migration 7b143170-c785-4a8c-a5d5-85471ab4fb59
Jul 25 15:42:36 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:36 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e1587fa-2745-4b54-acdb-4d919cf19fb1 req-54c719af-2ac3-4b14-b851-798783bcc682 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-changed-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e1587fa-2745-4b54-acdb-4d919cf19fb1 req-54c719af-2ac3-4b14-b851-798783bcc682 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Refreshing instance network info cache due to event network-changed-32e983c7-b4e5-47f6-ab3a-f82d87ea5273. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e1587fa-2745-4b54-acdb-4d919cf19fb1 req-54c719af-2ac3-4b14-b851-798783bcc682 service nova] Acquiring lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e1587fa-2745-4b54-acdb-4d919cf19fb1 req-54c719af-2ac3-4b14-b851-798783bcc682 service nova] Acquired lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-0e1587fa-2745-4b54-acdb-4d919cf19fb1 req-54c719af-2ac3-4b14-b851-798783bcc682 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Refreshing network info cache for port 32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.594s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:37 user nova-compute[70869]: INFO nova.compute.manager [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Migrating
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.359s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-0e1587fa-2745-4b54-acdb-4d919cf19fb1 req-54c719af-2ac3-4b14-b851-798783bcc682 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updated VIF entry in instance network info cache for port 32e983c7-b4e5-47f6-ab3a-f82d87ea5273. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-0e1587fa-2745-4b54-acdb-4d919cf19fb1 req-54c719af-2ac3-4b14-b851-798783bcc682 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating instance_info_cache with network_info: [{"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e1587fa-2745-4b54-acdb-4d919cf19fb1 req-54c719af-2ac3-4b14-b851-798783bcc682 service nova] Releasing lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquired lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG nova.network.neutron [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:37 user nova-compute[70869]: INFO nova.compute.manager [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Detaching volume b79faee5-388f-4ad0-ac51-e349ce7e7e32
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: INFO nova.virt.block_device [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Attempting to driver detach volume b79faee5-388f-4ad0-ac51-e349ce7e7e32 from mountpoint /dev/vdb
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Attempting to detach device vdb from instance bb780430-2cb6-4443-98ed-a224ec35bf57 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:42:38 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:42:38 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:42:38 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:42:38 user nova-compute[70869]:   <serial>b79faee5-388f-4ad0-ac51-e349ce7e7e32</serial>
Jul 25 15:42:38 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:42:38 user nova-compute[70869]: </disk>
Jul 25 15:42:38 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:42:38 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Successfully detached device vdb from instance bb780430-2cb6-4443-98ed-a224ec35bf57 from the persistent domain config.
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb780430-2cb6-4443-98ed-a224ec35bf57 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:42:38 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:42:38 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:42:38 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:42:38 user nova-compute[70869]:   <serial>b79faee5-388f-4ad0-ac51-e349ce7e7e32</serial>
Jul 25 15:42:38 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:42:38 user nova-compute[70869]: </disk>
Jul 25 15:42:38 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.network.neutron [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating instance_info_cache with network_info: [{"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Releasing lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Starting migrate_disk_and_power_off {{(pid=70869) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299758.5081534, bb780430-2cb6-4443-98ed-a224ec35bf57 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb780430-2cb6-4443-98ed-a224ec35bf57 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:42:38 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Successfully detached device vdb from instance bb780430-2cb6-4443-98ed-a224ec35bf57 from the live domain config.
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBfAsobY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:42:38 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b57a15-1f0f-4937-862c-e822e6ab2776]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:42:38 user nova-compute[70869]: No targets found.
Jul 25 15:42:38 user nova-compute[70869]: iSNS:
Jul 25 15:42:38 user nova-compute[70869]: No targets found.
Jul 25 15:42:38 user nova-compute[70869]: STATIC:
Jul 25 15:42:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:42:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32
Jul 25 15:42:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4
Jul 25 15:42:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:42:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:42:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:42:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:38 user nova-compute[70869]: FIRMWARE:
Jul 25 15:42:38 user nova-compute[70869]: No targets found.
Jul 25 15:42:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:42:38 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:42:38 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2b8575-7d47-4eb7-ba75-50e34d4f63be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[140b6812-1bf6-43b4-a85b-6aa4407a9c3b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4 (non-flash)
Jul 25 15:42:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 (non-flash)
Jul 25 15:42:38 user nova-compute[70869]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4 (non-flash)
Jul 25 15:42:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c23fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[36acb615-ae8c-40d4-a72c-a9ff62671500]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ec35f-163f-4916-a651-e972bc68e4c4]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99d4e79-ce2b-49c3-9b31-0674028e31af]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2316d3-0045-4dfc-89af-c8c26debf06a]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[86945538-f7c8-4e3f-9ac8-02b13d277ffb]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[372c68b1-88b6-43ee-840f-3d63bdd7f145]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32, portal: 172.16.0.220,3260]
Jul 25 15:42:38 user nova-compute[70869]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32, portal: 172.16.0.220,3260] successful.
Jul 25 15:42:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79faee5-388f-4ad0-ac51-e349ce7e7e32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[427dd9ec-add4-487a-9f7c-1f9ba5c41708]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-bf67b4f2-f185-44b7-8bef-f340ef681ed2 req-9bf12875-f698-47d9-a846-733837a88ef3 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-unplugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bf67b4f2-f185-44b7-8bef-f340ef681ed2 req-9bf12875-f698-47d9-a846-733837a88ef3 service nova] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bf67b4f2-f185-44b7-8bef-f340ef681ed2 req-9bf12875-f698-47d9-a846-733837a88ef3 service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-bf67b4f2-f185-44b7-8bef-f340ef681ed2 req-9bf12875-f698-47d9-a846-733837a88ef3 service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-bf67b4f2-f185-44b7-8bef-f340ef681ed2 req-9bf12875-f698-47d9-a846-733837a88ef3 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] No waiting events found dispatching network-vif-unplugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:42:38 user nova-compute[70869]: WARNING nova.compute.manager [req-bf67b4f2-f185-44b7-8bef-f340ef681ed2 req-9bf12875-f698-47d9-a846-733837a88ef3 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received unexpected event network-vif-unplugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 for instance with vm_state active and task_state resize_migrating.
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] <== disconnect_volume: return (426ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:42:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Instance destroyed successfully.
Jul 25 15:42:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873623589',display_name='tempest-ServerActionsTestOtherA-server-1873623589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873623589',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-94gicbbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:42:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-183118264-network", "vif_mac": "fa:16:3e:43:92:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-183118264-network", "vif_mac": "fa:16:3e:43:92:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_vif [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32e983c7-b4, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:39 user nova-compute[70869]: INFO os_vif [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4')
Jul 25 15:42:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVGfPgEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:42:39 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9472890-099e-4e45-a419-e31d2d668156]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:42:39 user nova-compute[70869]: No targets found.
Jul 25 15:42:39 user nova-compute[70869]: iSNS:
Jul 25 15:42:39 user nova-compute[70869]: No targets found.
Jul 25 15:42:39 user nova-compute[70869]: STATIC:
Jul 25 15:42:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:42:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4
Jul 25 15:42:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:42:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:42:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:42:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:42:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:42:39 user nova-compute[70869]: FIRMWARE:
Jul 25 15:42:39 user nova-compute[70869]: No targets found.
Jul 25 15:42:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:42:39 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:42:39 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5870861-70ab-41e3-80d8-e6e1128e6707]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dad06c-73da-44b8-8f55-b752c58e2bb3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:39 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:39 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:39 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:39 user nova-compute[70869]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4 (non-flash)
Jul 25 15:42:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:39 user nova-compute[70869]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:39 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:39 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:39 user nova-compute[70869]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90467301-6a74-4d55-9729-00878dc031b4 (non-flash)
Jul 25 15:42:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4341fa050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c62ad15-a2ab-433f-8a5d-3b9eee27a22b]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297849f-19c7-499d-a3e7-bfa68e6132d7]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[964712ad-94e1-4bfe-b68e-2c787d3b8888]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cd2a73-f0e6-45fb-8185-1d9afe715613]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7aea25-e526-4e82-a520-fa8491f2da57]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc72cf3-7d96-4f18-be55-428187423f5c]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260]
Jul 25 15:42:39 user nova-compute[70869]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260] successful.
Jul 25 15:42:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dbd855-d7e3-4d02-89ba-e78bf3d37c66]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== disconnect_volume: return (410ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lazy-loading 'flavor' on Instance uuid bb780430-2cb6-4443-98ed-a224ec35bf57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e61ad668-c579-4772-abcb-7e9977ce108a tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.989s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:40 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:42:40 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7044MB free_disk=25.327606201171875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.network.neutron [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Port 32e983c7-b4e5-47f6-ab3a-f82d87ea5273 binding to destination host user is already ACTIVE {{(pid=70869) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Applying migration context for instance d384e3b6-8948-4db0-8d39-a340cb130c57 as it has an incoming, in-progress migration 94cc0e72-05b0-4894-894d-686ed1154513. Migration status is finished {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Applying migration context for instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f as it has an incoming, in-progress migration 7b143170-c785-4a8c-a5d5-85471ab4fb59. Migration status is migrating {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 15:42:40 user nova-compute[70869]: INFO nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating resource usage from migration 94cc0e72-05b0-4894-894d-686ed1154513
Jul 25 15:42:40 user nova-compute[70869]: INFO nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating resource usage from migration 7b143170-c785-4a8c-a5d5-85471ab4fb59
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-c6325af1-f0bb-4e37-bcfd-1249df711c06 req-b06c432d-eb37-495b-895e-28f8950b88fe service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c6325af1-f0bb-4e37-bcfd-1249df711c06 req-b06c432d-eb37-495b-895e-28f8950b88fe service nova] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c6325af1-f0bb-4e37-bcfd-1249df711c06 req-b06c432d-eb37-495b-895e-28f8950b88fe service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c6325af1-f0bb-4e37-bcfd-1249df711c06 req-b06c432d-eb37-495b-895e-28f8950b88fe service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.manager [req-c6325af1-f0bb-4e37-bcfd-1249df711c06 req-b06c432d-eb37-495b-895e-28f8950b88fe service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] No waiting events found dispatching network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:42:40 user nova-compute[70869]: WARNING nova.compute.manager [req-c6325af1-f0bb-4e37-bcfd-1249df711c06 req-b06c432d-eb37-495b-895e-28f8950b88fe service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received unexpected event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 for instance with vm_state active and task_state resize_migrated.
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance be3bdffd-27ff-49a8-9aef-ddf374f33752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bb780430-2cb6-4443-98ed-a224ec35bf57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e69fa561-b002-49d7-8251-3de03ae44940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Migration 94cc0e72-05b0-4894-894d-686ed1154513 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d384e3b6-8948-4db0-8d39-a340cb130c57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bba84347-9d28-4789-8d45-3e39770c8f4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 4d9706b8-2a69-4272-89d3-f8a985e0ad2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Migration 7b143170-c785-4a8c-a5d5-85471ab4fb59 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing inventories for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating ProviderTree inventory for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing aggregate associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, aggregates: None {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquired lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.network.neutron [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.objects.instance [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lazy-loading 'flavor' on Instance uuid be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-48f0bcf5-061c-4b6a-93c6-03fc577df5fc tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.466s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing trait associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41 {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.094s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] There are 0 instances to clean {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG nova.network.neutron [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating instance_info_cache with network_info: [{"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Releasing lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG os_brick.utils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c31fc-3f50-4ed3-b503-ef29fc414593]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca03c2db-0b6f-4e4e-82b8-bcd189ee593f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82ea10d-cbd1-45da-a3b3-6a52d35d671a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dec0b4-4c36-4ba6-b9d0-b224de63a3d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:42:42 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b79d699-3ba1-4935-8121-d790bd52de06]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG os_brick.utils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:42:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:42:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:42:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:42:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:42:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:42:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:42:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Starting finish_migration {{(pid=70869) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 25 15:42:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Instance directory exists: not creating {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 15:42:50 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Creating image(s)
Jul 25 15:42:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:42:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Ensure instance console log exists: /opt/stack/data/nova/instances/bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:42:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Start _get_guest_xml network_info=[{"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-183118264-network", "vif_mac": "fa:16:3e:43:92:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4d7617d9-5838-4c43-a66f-493e7c89ea2c', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVGfPgEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f', 'attached_at': '2023-07-25T15:42:50.000000', 'detached_at': '', 'volume_id': '1698b104-634b-4bdf-9890-34e7e05a41e8', 'serial': '1698b104-634b-4bdf-9890-34e7e05a41e8'}, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:42:50 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:42:50 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'vcpu_model' on Instance uuid bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVGfPgEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:42:51 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:42:51 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:42:51 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260" returned: 21 in 0.117s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1a449-0bfb-4716-9bbb-df1f9675a170]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:42:51 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7952b8-c173-4100-b634-77e8cf325b06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8] added
Jul 25 15:42:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.104s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb1e1fb-9c91-4557-bf12-32610d5418b8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e13c199-85d8-4f26-8377-d85b5ca00ba8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVGfPgEu {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVGfPgEu" returned: 0 in 0.248s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e4345-a18d-431c-a34c-144fa1ad369f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BVGfPgEu'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.177s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b9761d-4835-450c-bd19-59ad4d93ed49]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9d1126-7b7f-423c-925a-bb8a0b381041]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9c5a168-91c8-4af3-aba9-a48442100d64 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:51 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:51 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:51 user nova-compute[70869]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9c5a168-91c8-4af3-aba9-a48442100d64 (non-flash)
Jul 25 15:42:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:51 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:51 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:51 user nova-compute[70869]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9c5a168-91c8-4af3-aba9-a48442100d64 (non-flash)
Jul 25 15:42:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:42:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.219s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[36098c5e-af20-42be-997a-d4395d131559]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260]
Jul 25 15:42:52 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260] successful.
Jul 25 15:42:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.101s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ab6266-e3cb-4d92-9272-4afa4ccef3c7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0121cea6-b2ff-4b14-8571-fd5e5ac337f0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9c5a168-91c8-4af3-aba9-a48442100d64 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:52 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:52 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:52 user nova-compute[70869]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9c5a168-91c8-4af3-aba9-a48442100d64 (non-flash)
Jul 25 15:42:52 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:42:52 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:42:52 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:42:52 user nova-compute[70869]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9c5a168-91c8-4af3-aba9-a48442100d64 (non-flash)
Jul 25 15:42:52 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:42:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec25a9b8-05aa-4c41-bb02-bbcaab19d652]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVGfPgEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.263s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== connect_volume: return (2264ms) {'type': 'block', 'scsi_wwn': '23030633935613661', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030633935613661', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873623589',display_name='tempest-ServerActionsTestOtherA-server-1873623589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873623589',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-94gicbbv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-183118264-network", "vif_mac": "fa:16:3e:43:92:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-183118264-network", "vif_mac": "fa:16:3e:43:92:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:42:53 user nova-compute[70869]:   <uuid>bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f</uuid>
Jul 25 15:42:53 user nova-compute[70869]:   <name>instance-00000019</name>
Jul 25 15:42:53 user nova-compute[70869]:   <memory>2097152</memory>
Jul 25 15:42:53 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:42:53 user nova-compute[70869]:   <metadata>
Jul 25 15:42:53 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:42:53 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:42:53 user nova-compute[70869]:       <nova:name>tempest-ServerActionsTestOtherA-server-1873623589</nova:name>
Jul 25 15:42:53 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:42:50</nova:creationTime>
Jul 25 15:42:53 user nova-compute[70869]:       <nova:flavor name="m1.small">
Jul 25 15:42:53 user nova-compute[70869]:         <nova:memory>2048</nova:memory>
Jul 25 15:42:53 user nova-compute[70869]:         <nova:disk>20</nova:disk>
Jul 25 15:42:53 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:42:53 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:42:53 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:42:53 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:42:53 user nova-compute[70869]:       <nova:owner>
Jul 25 15:42:53 user nova-compute[70869]:         <nova:user uuid="3d09efb7dac2429a97ec41381705c5a5">tempest-ServerActionsTestOtherA-798279085-project-member</nova:user>
Jul 25 15:42:53 user nova-compute[70869]:         <nova:project uuid="f52ab59c5e0a442aa53ad1edd6b4ec5e">tempest-ServerActionsTestOtherA-798279085</nova:project>
Jul 25 15:42:53 user nova-compute[70869]:       </nova:owner>
Jul 25 15:42:53 user nova-compute[70869]:       <nova:ports>
Jul 25 15:42:53 user nova-compute[70869]:         <nova:port uuid="32e983c7-b4e5-47f6-ab3a-f82d87ea5273">
Jul 25 15:42:53 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 15:42:53 user nova-compute[70869]:         </nova:port>
Jul 25 15:42:53 user nova-compute[70869]:       </nova:ports>
Jul 25 15:42:53 user nova-compute[70869]:     </nova:instance>
Jul 25 15:42:53 user nova-compute[70869]:   </metadata>
Jul 25 15:42:53 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:42:53 user nova-compute[70869]:     <system>
Jul 25 15:42:53 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:42:53 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:42:53 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:42:53 user nova-compute[70869]:       <entry name="serial">bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f</entry>
Jul 25 15:42:53 user nova-compute[70869]:       <entry name="uuid">bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f</entry>
Jul 25 15:42:53 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:42:53 user nova-compute[70869]:     </system>
Jul 25 15:42:53 user nova-compute[70869]:   </sysinfo>
Jul 25 15:42:53 user nova-compute[70869]:   <os>
Jul 25 15:42:53 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:42:53 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:42:53 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:42:53 user nova-compute[70869]:   </os>
Jul 25 15:42:53 user nova-compute[70869]:   <features>
Jul 25 15:42:53 user nova-compute[70869]:     <acpi/>
Jul 25 15:42:53 user nova-compute[70869]:     <apic/>
Jul 25 15:42:53 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:42:53 user nova-compute[70869]:   </features>
Jul 25 15:42:53 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:42:53 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:42:53 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:42:53 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:42:53 user nova-compute[70869]:   </clock>
Jul 25 15:42:53 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:42:53 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:42:53 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:42:53 user nova-compute[70869]:   </cpu>
Jul 25 15:42:53 user nova-compute[70869]:   <devices>
Jul 25 15:42:53 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:42:53 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:42:53 user nova-compute[70869]:       <source dev="/dev/sde"/>
Jul 25 15:42:53 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:42:53 user nova-compute[70869]:       <serial>1698b104-634b-4bdf-9890-34e7e05a41e8</serial>
Jul 25 15:42:53 user nova-compute[70869]:     </disk>
Jul 25 15:42:53 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:42:53 user nova-compute[70869]:       <mac address="fa:16:3e:43:92:82"/>
Jul 25 15:42:53 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:42:53 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:42:53 user nova-compute[70869]:       <target dev="tap32e983c7-b4"/>
Jul 25 15:42:53 user nova-compute[70869]:     </interface>
Jul 25 15:42:53 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:42:53 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f/console.log" append="off"/>
Jul 25 15:42:53 user nova-compute[70869]:     </serial>
Jul 25 15:42:53 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:42:53 user nova-compute[70869]:     <video>
Jul 25 15:42:53 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:42:53 user nova-compute[70869]:     </video>
Jul 25 15:42:53 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:42:53 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:42:53 user nova-compute[70869]:     </rng>
Jul 25 15:42:53 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:42:53 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:42:53 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:42:53 user nova-compute[70869]:     </memballoon>
Jul 25 15:42:53 user nova-compute[70869]:   </devices>
Jul 25 15:42:53 user nova-compute[70869]: </domain>
Jul 25 15:42:53 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873623589',display_name='tempest-ServerActionsTestOtherA-server-1873623589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873623589',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-94gicbbv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-183118264-network", "vif_mac": "fa:16:3e:43:92:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-183118264-network", "vif_mac": "fa:16:3e:43:92:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG os_vif [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32e983c7-b4, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32e983c7-b4, col_values=(('external_ids', {'iface-id': '32e983c7-b4e5-47f6-ab3a-f82d87ea5273', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:92:82', 'vm-uuid': 'bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:53 user nova-compute[70869]: INFO os_vif [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4')
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] No VIF found with MAC fa:16:3e:43:92:82, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:42:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299759.2633414, bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:42:54 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] VM Stopped (Lifecycle Event)
Jul 25 15:42:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a0a63c5f-6db9-462a-a88a-5b83f5898a8b None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'flavor' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:54 user nova-compute[70869]: INFO nova.compute.manager [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Attaching volume f0a05b0f-6e2b-4195-94d0-3414bbe8f31c to /dev/vdb
Jul 25 15:42:54 user nova-compute[70869]: DEBUG os_brick.utils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba87e4c-858f-4130-92d5-f4eb01dafea9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b11c926-c435-4efd-9795-15bc31f35bbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[63544906-fe03-463a-a731-778fcff9e18b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbab9431-e863-4794-b955-c78ca0414e5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:42:54 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:42:54 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9241000-f666-4401-a2cd-9b4acdb22266]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG os_brick.utils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:42:54 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updating existing volume attachment record: 6a1297de-5b1d-4d9a-a9b9-73afa5e76dfb {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-354a1451-840a-4356-a1b0-ccc83d752678 req-fe496334-e997-4dc4-ad37-80484bee684f service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-354a1451-840a-4356-a1b0-ccc83d752678 req-fe496334-e997-4dc4-ad37-80484bee684f service nova] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-354a1451-840a-4356-a1b0-ccc83d752678 req-fe496334-e997-4dc4-ad37-80484bee684f service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-354a1451-840a-4356-a1b0-ccc83d752678 req-fe496334-e997-4dc4-ad37-80484bee684f service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-354a1451-840a-4356-a1b0-ccc83d752678 req-fe496334-e997-4dc4-ad37-80484bee684f service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] No waiting events found dispatching network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:42:55 user nova-compute[70869]: WARNING nova.compute.manager [req-354a1451-840a-4356-a1b0-ccc83d752678 req-fe496334-e997-4dc4-ad37-80484bee684f service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received unexpected event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 for instance with vm_state active and task_state resize_finish.
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299777.3005733, bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:42:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] VM Resumed (Lifecycle Event)
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:42:57 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Instance running successfully.
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Failed to set time: agent not configured {{(pid=70869) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-57703e95-09c6-4d5a-9212-b9247c039d35 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] finish_migration finished successfully. {{(pid=70869) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:42:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299777.3022084, bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:42:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] VM Started (Lifecycle Event)
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:42:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d88e684-a5b9-4eff-9f8e-6e7e236f9694 req-f78b9ed7-92f3-424d-8e6f-191c404c50b2 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:42:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d88e684-a5b9-4eff-9f8e-6e7e236f9694 req-f78b9ed7-92f3-424d-8e6f-191c404c50b2 service nova] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:42:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d88e684-a5b9-4eff-9f8e-6e7e236f9694 req-f78b9ed7-92f3-424d-8e6f-191c404c50b2 service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:42:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d88e684-a5b9-4eff-9f8e-6e7e236f9694 req-f78b9ed7-92f3-424d-8e6f-191c404c50b2 service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:42:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d88e684-a5b9-4eff-9f8e-6e7e236f9694 req-f78b9ed7-92f3-424d-8e6f-191c404c50b2 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] No waiting events found dispatching network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:42:57 user nova-compute[70869]: WARNING nova.compute.manager [req-9d88e684-a5b9-4eff-9f8e-6e7e236f9694 req-f78b9ed7-92f3-424d-8e6f-191c404c50b2 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received unexpected event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 for instance with vm_state active and task_state resize_finish.
Jul 25 15:42:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:42:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtcHCblY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:43:04 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:04 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:04 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccfe8eb-fb92-4a71-a8b7-568f1d61bc59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:43:04 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[17884dfe-cffa-4d96-803c-d5f57979a6de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c] added
Jul 25 15:43:04 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[99581a12-6dcb-4258-96a1-8fcf51255b45]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0725133e-fdbe-49ea-b87e-2879eb3ba6fc]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtcHCblY {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtcHCblY" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4839ed65-d9fd-431c-9d1b-52b4c649e61f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TtcHCblY'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba86d0f-056d-4596-a55e-52127a6dc95f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6dea72-6f44-45af-8cec-478d4f8956ab]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:04 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:04 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e80a3-e677-46fc-8940-7a2cc648225f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260]
Jul 25 15:43:04 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260] successful.
Jul 25 15:43:04 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd2cb6-0a1f-4280-8603-79252bbbb949]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a691aec3-0cd7-420d-bb72-e5d9312cbe65]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:04 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:04 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:04 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b9d71-b292-47f1-bdb7-cec68972ffc0]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:43:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtcHCblY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:43:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23030396665623565', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:43:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030396665623565', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:43:05 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'flavor' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:43:05 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:43:05 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:43:05 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:43:05 user nova-compute[70869]:   <serial>f0a05b0f-6e2b-4195-94d0-3414bbe8f31c</serial>
Jul 25 15:43:05 user nova-compute[70869]: </disk>
Jul 25 15:43:05 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:43:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:43:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:43:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No VIF found with MAC fa:16:3e:4a:f2:ce, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:43:06 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Port eebac77a-9411-485f-b850-c2798d0b4b24 binding to destination host user is already ACTIVE {{(pid=70869) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 25 15:43:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquired lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:06 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:43:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7779c1ed-500e-4288-9b4a-a16b0dc3d742 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.851s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance_info_cache with network_info: [{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Releasing lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Creating tmpfile /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/tmpl5dl_8tu to verify with other compute node that the instance is on the same shared storage. {{(pid=70869) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-587a20f8-683a-4ee5-a041-53b39e93241a req-dc377694-23d1-4331-b4a2-fe3835c3b1d5 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-unplugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-587a20f8-683a-4ee5-a041-53b39e93241a req-dc377694-23d1-4331-b4a2-fe3835c3b1d5 service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-587a20f8-683a-4ee5-a041-53b39e93241a req-dc377694-23d1-4331-b4a2-fe3835c3b1d5 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-587a20f8-683a-4ee5-a041-53b39e93241a req-dc377694-23d1-4331-b4a2-fe3835c3b1d5 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-587a20f8-683a-4ee5-a041-53b39e93241a req-dc377694-23d1-4331-b4a2-fe3835c3b1d5 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-unplugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:07 user nova-compute[70869]: WARNING nova.compute.manager [req-587a20f8-683a-4ee5-a041-53b39e93241a req-dc377694-23d1-4331-b4a2-fe3835c3b1d5 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-unplugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state resized and task_state resize_reverting.
Jul 25 15:43:08 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance destroyed successfully.
Jul 25 15:43:08 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'resources' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-244416485',display_name='tempest-ServerActionsTestOtherB-server-244416485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-244416485',id=19,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCXboWq8wEzceGCnyi332NqxevvINDJCRjntKF4hIJqpSF49+vs1jbRHF6AATQTYe8No7x4pmRlaWfwGgtbv6ak2EUh6sjCd7bivOrD55NzuNL4hDOGe4J6h+BwET+hSw==',key_name='tempest-keypair-273420356',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a893391d45fd4eafa016e42722702ac2',ramdisk_id='',reservation_id='r-mt2igj69',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1757328199',owner_user_name='tempest-ServerActionsTestOtherB-1757328199-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:41:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5363af86370d49bd8082de16ae83a936',uuid=d384e3b6-8948-4db0-8d39-a340cb130c57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converting VIF {"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_vif [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeebac77a-94, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:08 user nova-compute[70869]: INFO os_vif [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94')
Jul 25 15:43:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:43:08 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b437a2-1ab9-4849-a0a0-9de692730f21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:43:08 user nova-compute[70869]: No targets found.
Jul 25 15:43:08 user nova-compute[70869]: iSNS:
Jul 25 15:43:08 user nova-compute[70869]: No targets found.
Jul 25 15:43:08 user nova-compute[70869]: STATIC:
Jul 25 15:43:08 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:43:08 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:08 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:08 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c
Jul 25 15:43:08 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:08 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:08 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:43:08 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:08 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:08 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:43:08 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:08 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:08 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:43:08 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:08 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:08 user nova-compute[70869]: FIRMWARE:
Jul 25 15:43:08 user nova-compute[70869]: No targets found.
Jul 25 15:43:08 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:43:08 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:43:08 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[413d25d2-540a-4ed9-8d27-d6a9924d446d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1ba188-be4c-44a5-84b5-10123a33b5e9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:08 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:08 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:08 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:08 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:08 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:08 user nova-compute[70869]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:08 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:08 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:08 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:08 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4341f9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6'): ({'sdf'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Removing single pathed devices sdf {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca14c090-292e-41b7-9879-089978b3f72c]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619fbc9-ce26-49f9-b9aa-fff6ab52fa1a]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Flushing IO for device /dev/sdf {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaed706-853d-4968-90f4-116dcbb46ac5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38e0d3e-e6f1-402b-bb9e-355372a66d8f]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] SCSI volumes sdf have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c27d1e9-7875-4d75-ae68-d19b89151ad0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e90087-c7e8-4489-b5f4-cf92066a9499]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]
Jul 25 15:43:08 user nova-compute[70869]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.
Jul 25 15:43:08 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b5779-13dc-4314-a2f3-88f5be5a56e9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] <== disconnect_volume: return (330ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:43:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:43:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:09 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'migration_context' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f99133d1-c2db-4a60-8079-b455a2d90e94 req-59567eb1-da42-476b-b25b-32d2148498ea service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f99133d1-c2db-4a60-8079-b455a2d90e94 req-59567eb1-da42-476b-b25b-32d2148498ea service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f99133d1-c2db-4a60-8079-b455a2d90e94 req-59567eb1-da42-476b-b25b-32d2148498ea service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f99133d1-c2db-4a60-8079-b455a2d90e94 req-59567eb1-da42-476b-b25b-32d2148498ea service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f99133d1-c2db-4a60-8079-b455a2d90e94 req-59567eb1-da42-476b-b25b-32d2148498ea service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:09 user nova-compute[70869]: WARNING nova.compute.manager [req-f99133d1-c2db-4a60-8079-b455a2d90e94 req-59567eb1-da42-476b-b25b-32d2148498ea service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state resized and task_state resize_reverting.
Jul 25 15:43:10 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:43:10 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:43:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.615s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:10 user nova-compute[70869]: INFO nova.compute.manager [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Swapping old allocation on dict_keys(['42d61115-f6d1-4e6b-8440-2ada622c2cfd']) held by migration 94cc0e72-05b0-4894-894d-686ed1154513 for instance
Jul 25 15:43:10 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Overwriting current allocation {'allocations': {'42d61115-f6d1-4e6b-8440-2ada622c2cfd': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': 'a893391d45fd4eafa016e42722702ac2', 'user_id': '5363af86370d49bd8082de16ae83a936', 'consumer_generation': 1} on consumer d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 25 15:43:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquired lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:10 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance_info_cache with network_info: [{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Releasing lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG os_brick.utils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[785577e0-ff1f-4c2c-9cfd-30d9f801fe88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb419a-ea8c-4d6a-93b8-463243d22c9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf364f-7fd8-4f46-9876-086009f6939b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c3670e-e59f-45b3-ba73-006e3a22587c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:43:11 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:43:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f04f5f8-0b5e-45b8-811e-fa01b39d5ecb]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG os_brick.utils [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:43:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-d0e3b752-95dc-4745-8fc0-ad625eba9796 req-a096348b-9e42-47b6-b8ce-a0beea03f18e service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-d0e3b752-95dc-4745-8fc0-ad625eba9796 req-a096348b-9e42-47b6-b8ce-a0beea03f18e service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing instance network info cache due to event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:43:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d0e3b752-95dc-4745-8fc0-ad625eba9796 req-a096348b-9e42-47b6-b8ce-a0beea03f18e service nova] Acquiring lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d0e3b752-95dc-4745-8fc0-ad625eba9796 req-a096348b-9e42-47b6-b8ce-a0beea03f18e service nova] Acquired lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:16 user nova-compute[70869]: DEBUG nova.network.neutron [req-d0e3b752-95dc-4745-8fc0-ad625eba9796 req-a096348b-9e42-47b6-b8ce-a0beea03f18e service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:43:17 user nova-compute[70869]: DEBUG nova.network.neutron [req-d0e3b752-95dc-4745-8fc0-ad625eba9796 req-a096348b-9e42-47b6-b8ce-a0beea03f18e service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updated VIF entry in instance network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:43:17 user nova-compute[70869]: DEBUG nova.network.neutron [req-d0e3b752-95dc-4745-8fc0-ad625eba9796 req-a096348b-9e42-47b6-b8ce-a0beea03f18e service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updating instance_info_cache with network_info: [{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d0e3b752-95dc-4745-8fc0-ad625eba9796 req-a096348b-9e42-47b6-b8ce-a0beea03f18e service nova] Releasing lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:43:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:18 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:43:18 user nova-compute[70869]: INFO nova.compute.claims [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Claim successful on node user
Jul 25 15:43:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:18 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:43:18 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:43:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:43:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:43:18 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:43:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:43:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:43:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:18 user nova-compute[70869]: INFO nova.virt.block_device [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Booting with volume-backed-image c7f43ee3-f119-42a6-81e5-b18d0ee6d581 at /dev/vda
Jul 25 15:43:18 user nova-compute[70869]: DEBUG nova.policy [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02dfa618b8fc4b06b5e396b7da9e8443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3735c3192f424a8abee7c1874609f005', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.compute.manager [req-565ca202-5d9e-41c0-9943-09c6d8ed8b7b req-647c3b2d-141d-4806-b64a-a310d3b34f2a service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.compute.manager [req-565ca202-5d9e-41c0-9943-09c6d8ed8b7b req-647c3b2d-141d-4806-b64a-a310d3b34f2a service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing instance network info cache due to event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-565ca202-5d9e-41c0-9943-09c6d8ed8b7b req-647c3b2d-141d-4806-b64a-a310d3b34f2a service nova] Acquiring lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-565ca202-5d9e-41c0-9943-09c6d8ed8b7b req-647c3b2d-141d-4806-b64a-a310d3b34f2a service nova] Acquired lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.network.neutron [req-565ca202-5d9e-41c0-9943-09c6d8ed8b7b req-647c3b2d-141d-4806-b64a-a310d3b34f2a service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Starting finish_revert_migration {{(pid=70869) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Start _get_guest_xml network_info=[{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2c6f9b58-8c58-40f1-984a-0687a9500b83', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd384e3b6-8948-4db0-8d39-a340cb130c57', 'attached_at': '2023-07-25T15:43:19.000000', 'detached_at': '', 'volume_id': '6705f875-bf92-4305-8d7d-6d56c565bbf6', 'serial': '6705f875-bf92-4305-8d7d-6d56c565bbf6'}, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:43:19 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:19 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'vcpu_model' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:43:19 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:19 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:19 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b599a7-4508-416f-971c-23bd1030a530]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:43:19 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e485cf7d-4a31-4517-94da-5fce268f1178]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6] added
Jul 25 15:43:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd0f3ba-99e2-4545-a563-fda2f7ccd174]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c56407-7a0b-4e79-a975-df7d878b9eef]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYkqcBAt {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYkqcBAt" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f0f96-8582-4c0f-b4cb-3533c1a4cc06]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PYkqcBAt'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9794d-c57e-4124-a873-690efe751792]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e2447b-7040-4d59-bd38-9c7656be5f16]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb9bb0e-df50-4659-873a-e479ef7b039c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]
Jul 25 15:43:19 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.
Jul 25 15:43:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8c5d29-4d5c-43f6-b30e-c6f0852fe3e7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aab4fe-68dc-4ed0-be1a-515ba9810430]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:19 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b08356-9462-468f-9f71-bd5a7409755b]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.network.neutron [req-565ca202-5d9e-41c0-9943-09c6d8ed8b7b req-647c3b2d-141d-4806-b64a-a310d3b34f2a service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updated VIF entry in instance network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG nova.network.neutron [req-565ca202-5d9e-41c0-9943-09c6d8ed8b7b req-647c3b2d-141d-4806-b64a-a310d3b34f2a service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updating instance_info_cache with network_info: [{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-565ca202-5d9e-41c0-9943-09c6d8ed8b7b req-647c3b2d-141d-4806-b64a-a310d3b34f2a service nova] Releasing lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Successfully created port: 8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23333313036353761', 'path': '/dev/sdf'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333313036353761', 'path': '/dev/sdf'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-244416485',display_name='tempest-ServerActionsTestOtherB-server-244416485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-244416485',id=19,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCXboWq8wEzceGCnyi332NqxevvINDJCRjntKF4hIJqpSF49+vs1jbRHF6AATQTYe8No7x4pmRlaWfwGgtbv6ak2EUh6sjCd7bivOrD55NzuNL4hDOGe4J6h+BwET+hSw==',key_name='tempest-keypair-273420356',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a893391d45fd4eafa016e42722702ac2',ramdisk_id='',reservation_id='r-mt2igj69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1757328199',owner_user_name='tempest-ServerActionsTestOtherB-1757328199-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5363af86370d49bd8082de16ae83a936',uuid=d384e3b6-8948-4db0-8d39-a340cb130c57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converting VIF {"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:43:20 user nova-compute[70869]:   <uuid>d384e3b6-8948-4db0-8d39-a340cb130c57</uuid>
Jul 25 15:43:20 user nova-compute[70869]:   <name>instance-00000013</name>
Jul 25 15:43:20 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:43:20 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:43:20 user nova-compute[70869]:   <metadata>
Jul 25 15:43:20 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:43:20 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:43:20 user nova-compute[70869]:       <nova:name>tempest-ServerActionsTestOtherB-server-244416485</nova:name>
Jul 25 15:43:20 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:43:19</nova:creationTime>
Jul 25 15:43:20 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:43:20 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:43:20 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:43:20 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:43:20 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:43:20 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:43:20 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:43:20 user nova-compute[70869]:       <nova:owner>
Jul 25 15:43:20 user nova-compute[70869]:         <nova:user uuid="5363af86370d49bd8082de16ae83a936">tempest-ServerActionsTestOtherB-1757328199-project-member</nova:user>
Jul 25 15:43:20 user nova-compute[70869]:         <nova:project uuid="a893391d45fd4eafa016e42722702ac2">tempest-ServerActionsTestOtherB-1757328199</nova:project>
Jul 25 15:43:20 user nova-compute[70869]:       </nova:owner>
Jul 25 15:43:20 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:43:20 user nova-compute[70869]:       <nova:ports>
Jul 25 15:43:20 user nova-compute[70869]:         <nova:port uuid="eebac77a-9411-485f-b850-c2798d0b4b24">
Jul 25 15:43:20 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 15:43:20 user nova-compute[70869]:         </nova:port>
Jul 25 15:43:20 user nova-compute[70869]:       </nova:ports>
Jul 25 15:43:20 user nova-compute[70869]:     </nova:instance>
Jul 25 15:43:20 user nova-compute[70869]:   </metadata>
Jul 25 15:43:20 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:43:20 user nova-compute[70869]:     <system>
Jul 25 15:43:20 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:43:20 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:43:20 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:43:20 user nova-compute[70869]:       <entry name="serial">d384e3b6-8948-4db0-8d39-a340cb130c57</entry>
Jul 25 15:43:20 user nova-compute[70869]:       <entry name="uuid">d384e3b6-8948-4db0-8d39-a340cb130c57</entry>
Jul 25 15:43:20 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:43:20 user nova-compute[70869]:     </system>
Jul 25 15:43:20 user nova-compute[70869]:   </sysinfo>
Jul 25 15:43:20 user nova-compute[70869]:   <os>
Jul 25 15:43:20 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:43:20 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:43:20 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:43:20 user nova-compute[70869]:   </os>
Jul 25 15:43:20 user nova-compute[70869]:   <features>
Jul 25 15:43:20 user nova-compute[70869]:     <acpi/>
Jul 25 15:43:20 user nova-compute[70869]:     <apic/>
Jul 25 15:43:20 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:43:20 user nova-compute[70869]:   </features>
Jul 25 15:43:20 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:43:20 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:43:20 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:43:20 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:43:20 user nova-compute[70869]:   </clock>
Jul 25 15:43:20 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:43:20 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:43:20 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:43:20 user nova-compute[70869]:   </cpu>
Jul 25 15:43:20 user nova-compute[70869]:   <devices>
Jul 25 15:43:20 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:43:20 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:43:20 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk"/>
Jul 25 15:43:20 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:43:20 user nova-compute[70869]:     </disk>
Jul 25 15:43:20 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:43:20 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:43:20 user nova-compute[70869]:       <source dev="/dev/sdf"/>
Jul 25 15:43:20 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:43:20 user nova-compute[70869]:       <serial>6705f875-bf92-4305-8d7d-6d56c565bbf6</serial>
Jul 25 15:43:20 user nova-compute[70869]:     </disk>
Jul 25 15:43:20 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:43:20 user nova-compute[70869]:       <mac address="fa:16:3e:e3:a3:59"/>
Jul 25 15:43:20 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:20 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:43:20 user nova-compute[70869]:       <target dev="tapeebac77a-94"/>
Jul 25 15:43:20 user nova-compute[70869]:     </interface>
Jul 25 15:43:20 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:43:20 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/console.log" append="off"/>
Jul 25 15:43:20 user nova-compute[70869]:     </serial>
Jul 25 15:43:20 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:43:20 user nova-compute[70869]:     <video>
Jul 25 15:43:20 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:20 user nova-compute[70869]:     </video>
Jul 25 15:43:20 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:43:20 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:43:20 user nova-compute[70869]:     </rng>
Jul 25 15:43:20 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:43:20 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:43:20 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:43:20 user nova-compute[70869]:     </memballoon>
Jul 25 15:43:20 user nova-compute[70869]:   </devices>
Jul 25 15:43:20 user nova-compute[70869]: </domain>
Jul 25 15:43:20 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-244416485',display_name='tempest-ServerActionsTestOtherB-server-244416485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-244416485',id=19,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCXboWq8wEzceGCnyi332NqxevvINDJCRjntKF4hIJqpSF49+vs1jbRHF6AATQTYe8No7x4pmRlaWfwGgtbv6ak2EUh6sjCd7bivOrD55NzuNL4hDOGe4J6h+BwET+hSw==',key_name='tempest-keypair-273420356',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a893391d45fd4eafa016e42722702ac2',ramdisk_id='',reservation_id='r-mt2igj69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1757328199',owner_user_name='tempest-ServerActionsTestOtherB-1757328199-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:43:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5363af86370d49bd8082de16ae83a936',uuid=d384e3b6-8948-4db0-8d39-a340cb130c57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converting VIF {"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG os_vif [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeebac77a-94, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeebac77a-94, col_values=(('external_ids', {'iface-id': 'eebac77a-9411-485f-b850-c2798d0b4b24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:a3:59', 'vm-uuid': 'd384e3b6-8948-4db0-8d39-a340cb130c57'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:20 user nova-compute[70869]: INFO os_vif [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94')
Jul 25 15:43:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Successfully updated port: 8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquired lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-911b65cf-4540-4c4d-bb2e-12b68ca0cfd9 req-ebb07701-cd03-4918-a7f8-f77250582e90 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-changed-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-911b65cf-4540-4c4d-bb2e-12b68ca0cfd9 req-ebb07701-cd03-4918-a7f8-f77250582e90 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Refreshing instance network info cache due to event network-changed-8624ca7f-ed89-4043-8c98-806cdf440681. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-911b65cf-4540-4c4d-bb2e-12b68ca0cfd9 req-ebb07701-cd03-4918-a7f8-f77250582e90 service nova] Acquiring lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-156b191d-ea95-46a1-b729-9d33939351e9 req-c557e907-809a-43c3-8dbd-8cd28b862bdc service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-156b191d-ea95-46a1-b729-9d33939351e9 req-c557e907-809a-43c3-8dbd-8cd28b862bdc service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-156b191d-ea95-46a1-b729-9d33939351e9 req-c557e907-809a-43c3-8dbd-8cd28b862bdc service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-156b191d-ea95-46a1-b729-9d33939351e9 req-c557e907-809a-43c3-8dbd-8cd28b862bdc service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-156b191d-ea95-46a1-b729-9d33939351e9 req-c557e907-809a-43c3-8dbd-8cd28b862bdc service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:22 user nova-compute[70869]: WARNING nova.compute.manager [req-156b191d-ea95-46a1-b729-9d33939351e9 req-c557e907-809a-43c3-8dbd-8cd28b862bdc service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state resized and task_state resize_reverting.
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Updating instance_info_cache with network_info: [{"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Releasing lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Instance network_info: |[{"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-911b65cf-4540-4c4d-bb2e-12b68ca0cfd9 req-ebb07701-cd03-4918-a7f8-f77250582e90 service nova] Acquired lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-911b65cf-4540-4c4d-bb2e-12b68ca0cfd9 req-ebb07701-cd03-4918-a7f8-f77250582e90 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Refreshing network info cache for port 8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299788.2928536, d384e3b6-8948-4db0-8d39-a340cb130c57 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:23 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] VM Stopped (Lifecycle Event)
Jul 25 15:43:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-07fbc243-2eb6-473b-a0b0-3e0970e13d15 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:23 user nova-compute[70869]: INFO nova.compute.manager [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Terminating instance
Jul 25 15:43:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-911b65cf-4540-4c4d-bb2e-12b68ca0cfd9 req-ebb07701-cd03-4918-a7f8-f77250582e90 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Updated VIF entry in instance network info cache for port 8624ca7f-ed89-4043-8c98-806cdf440681. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-911b65cf-4540-4c4d-bb2e-12b68ca0cfd9 req-ebb07701-cd03-4918-a7f8-f77250582e90 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Updating instance_info_cache with network_info: [{"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-911b65cf-4540-4c4d-bb2e-12b68ca0cfd9 req-ebb07701-cd03-4918-a7f8-f77250582e90 service nova] Releasing lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Instance destroyed successfully.
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.objects.instance [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lazy-loading 'resources' on Instance uuid be3bdffd-27ff-49a8-9aef-ddf374f33752 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-316945857',display_name='tempest-TestServerVolumeAttachmentScenario-server-316945857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-316945857',id=21,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRM9bWvSN9pFLXMwDnvRWq2QcAhd2QrDqJ88M/bK5EjVzkWTG1k2E2n6gKDBJoMQTlOimf7mYmnRLKAXXn63tYJkwfYY1T0EmgeQWzck3t0Ha2iUYNQU5EC9Z6eil/gUQ==',key_name='tempest-keypair-1489029153',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eed694bf0a94479da8c2083d9c08ab70',ramdisk_id='',reservation_id='r-eeupjgo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2135956578',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2135956578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36d974eda33840e49deae13024233178',uuid=be3bdffd-27ff-49a8-9aef-ddf374f33752,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Converting VIF {"id": "f71a78b3-ec67-4803-95e3-2490492edd10", "address": "fa:16:3e:39:42:48", "network": {"id": "48088fa9-9260-4681-98cc-3ad5054a89ee", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1700067291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed694bf0a94479da8c2083d9c08ab70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf71a78b3-ec", "ovs_interfaceid": "f71a78b3-ec67-4803-95e3-2490492edd10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:42:48,bridge_name='br-int',has_traffic_filtering=True,id=f71a78b3-ec67-4803-95e3-2490492edd10,network=Network(48088fa9-9260-4681-98cc-3ad5054a89ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71a78b3-ec') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG os_vif [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:42:48,bridge_name='br-int',has_traffic_filtering=True,id=f71a78b3-ec67-4803-95e3-2490492edd10,network=Network(48088fa9-9260-4681-98cc-3ad5054a89ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71a78b3-ec') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf71a78b3-ec, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:24 user nova-compute[70869]: INFO os_vif [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:42:48,bridge_name='br-int',has_traffic_filtering=True,id=f71a78b3-ec67-4803-95e3-2490492edd10,network=Network(48088fa9-9260-4681-98cc-3ad5054a89ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf71a78b3-ec')
Jul 25 15:43:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Deleting instance files /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752_del
Jul 25 15:43:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Deletion of /opt/stack/data/nova/instances/be3bdffd-27ff-49a8-9aef-ddf374f33752_del complete
Jul 25 15:43:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:24 user nova-compute[70869]: INFO nova.compute.manager [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Took 1.10 seconds to destroy the instance on the hypervisor.
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG os_brick.utils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c9c168-8381-4934-b87f-211b78b2e6f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b39ddb-0781-4e49-9cab-297a663c2d47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f845a2e-4676-4fb4-95a8-8fdf302b47a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d4846c-0a4e-48b5-93bb-a1ec13322dc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-unplugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] No waiting events found dispatching network-vif-unplugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-unplugged-f71a78b3-ec67-4803-95e3-2490492edd10 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] No waiting events found dispatching network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:24 user nova-compute[70869]: WARNING nova.compute.manager [req-3837666c-16c1-48da-86eb-6cc60ac2100c req-b24e908b-66dc-4b02-9add-da27dd8ad023 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received unexpected event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 for instance with vm_state active and task_state deleting.
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:43:24 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62747c-7866-4c59-a94d-45357e8c0a9d]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG os_brick.utils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Updating existing volume attachment record: f4e4b267-301a-43af-8bff-e09c3f57ef0c {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-9aa46b7b-e342-4f25-b444-817c3b679704 req-37a6f05c-f8cf-455d-9d06-9a75340e8fa4 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9aa46b7b-e342-4f25-b444-817c3b679704 req-37a6f05c-f8cf-455d-9d06-9a75340e8fa4 service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9aa46b7b-e342-4f25-b444-817c3b679704 req-37a6f05c-f8cf-455d-9d06-9a75340e8fa4 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9aa46b7b-e342-4f25-b444-817c3b679704 req-37a6f05c-f8cf-455d-9d06-9a75340e8fa4 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-9aa46b7b-e342-4f25-b444-817c3b679704 req-37a6f05c-f8cf-455d-9d06-9a75340e8fa4 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:24 user nova-compute[70869]: WARNING nova.compute.manager [req-9aa46b7b-e342-4f25-b444-817c3b679704 req-37a6f05c-f8cf-455d-9d06-9a75340e8fa4 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state resized and task_state resize_reverting.
Jul 25 15:43:25 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299805.0304132, d384e3b6-8948-4db0-8d39-a340cb130c57 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] VM Resumed (Lifecycle Event)
Jul 25 15:43:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:43:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance running successfully.
Jul 25 15:43:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] finish_revert_migration finished successfully. {{(pid=70869) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 25 15:43:25 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299805.036313, d384e3b6-8948-4db0-8d39-a340cb130c57 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] VM Started (Lifecycle Event)
Jul 25 15:43:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 25 15:43:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:25 user nova-compute[70869]: INFO nova.compute.manager [None req-f2b798cd-e335-4dbf-ac45-5108352729fe tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance to original state: 'active'
Jul 25 15:43:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:25 user nova-compute[70869]: INFO nova.compute.manager [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Rebooting instance
Jul 25 15:43:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquired lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:25 user nova-compute[70869]: DEBUG nova.network.neutron [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:43:26 user nova-compute[70869]: DEBUG nova.network.neutron [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updating instance_info_cache with network_info: [{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Releasing lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:27 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Took 2.63 seconds to deallocate network for instance.
Jul 25 15:43:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] No waiting events found dispatching network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:27 user nova-compute[70869]: WARNING nova.compute.manager [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received unexpected event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 for instance with vm_state active and task_state deleting.
Jul 25 15:43:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] No waiting events found dispatching network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:27 user nova-compute[70869]: WARNING nova.compute.manager [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received unexpected event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 for instance with vm_state active and task_state deleting.
Jul 25 15:43:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-unplugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] No waiting events found dispatching network-vif-unplugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-92ea73bb-6335-4ad2-96e9-293402ccc26e req-77d2be1e-67fb-47a6-af20-8896e6f18472 service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-unplugged-f71a78b3-ec67-4803-95e3-2490492edd10 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Instance destroyed successfully.
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'resources' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1969392480',display_name='tempest-TestMinimumBasicScenario-server-1969392480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1969392480',id=26,image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQgML7ATcFoxWxXjJc8agfkcR/GfGqrezO6JWItXGR4qsG0lUjNUHSBon21VdVXFvHrM1OdFDo7u7bX5JOxfW5DD+4X3WzLxSXlFymCahyF2wWw3cygbBT4zMhy49Dx6w==',key_name='tempest-TestMinimumBasicScenario-2020211488',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c07ad06e29c4d2dbe409fa13979b81b',ramdisk_id='',reservation_id='r-evznqodo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1773990321',owner_user_name='tempest-TestMinimumBasicScenario-1773990321-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:43:27Z,user_data=None,user_id='a905cee33a204704937a0224b3e6fab1',uuid=e69fa561-b002-49d7-8251-3de03ae44940,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converting VIF {"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_vif [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap110266bd-c3, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:28 user nova-compute[70869]: INFO os_vif [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3')
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtcHCblY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:43:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de53a95-ec02-487a-926b-cb1f028f3378]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:43:28 user nova-compute[70869]: No targets found.
Jul 25 15:43:28 user nova-compute[70869]: iSNS:
Jul 25 15:43:28 user nova-compute[70869]: No targets found.
Jul 25 15:43:28 user nova-compute[70869]: STATIC:
Jul 25 15:43:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:43:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c
Jul 25 15:43:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:43:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:43:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:43:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:28 user nova-compute[70869]: FIRMWARE:
Jul 25 15:43:28 user nova-compute[70869]: No targets found.
Jul 25 15:43:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:43:28 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:43:28 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2f2175-c89a-4742-a798-916f855e46a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8b2ad2-3d56-4b2e-9ddf-568d738e0b70]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4431b3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.872s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dd81b5-bb74-4ec0-a4be-feac8e550421]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc75fc3a-46ed-46a8-90bf-f99ec47f1ce8]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:43:28 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Deleted allocations for instance be3bdffd-27ff-49a8-9aef-ddf374f33752
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4bce83-ce78-4dcc-8d5c-ddf3bad85c7a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[896ff0b8-9ac8-4e31-8fc9-ea72e6c50d5d]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cef6a7-7cf2-4ef8-98bb-80d17496ff2c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-12f5767e-988b-413b-bce6-8a3854377f06 tempest-TestServerVolumeAttachmentScenario-2135956578 tempest-TestServerVolumeAttachmentScenario-2135956578-project-member] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.950s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1232d0bf-b728-4b31-8b1b-2a2b80af731f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260]
Jul 25 15:43:28 user nova-compute[70869]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260] successful.
Jul 25 15:43:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc448add-82d1-439a-9b4a-ba83b246bf7e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] <== disconnect_volume: return (482ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Start _get_guest_xml network_info=[{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed132aaf-7487-4fae-8bce-0c773d559b1a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'ed132aaf-7487-4fae-8bce-0c773d559b1a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6a1297de-5b1d-4d9a-a9b9-73afa5e76dfb', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtcHCblY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e69fa561-b002-49d7-8251-3de03ae44940', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 'serial': 'f0a05b0f-6e2b-4195-94d0-3414bbe8f31c'}, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:43:28 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:28 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ed132aaf-7487-4fae-8bce-0c773d559b1a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'vcpu_model' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtcHCblY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:43:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:28 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f1f2c1-c813-486b-8afb-83bb5fc103f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:43:28 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5caecd-bdb7-44f8-9cd9-e4dd1fd4e6a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c] added
Jul 25 15:43:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[467631e5-b21e-46f4-9613-282e868909d7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f12eefd-9c90-475d-b9db-9c0278c59cb5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtcHCblY {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtcHCblY" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef26ac0-48aa-4eaf-b3e3-1c5bb74b733a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TtcHCblY'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ef33a3-27fb-4731-9f5f-115686a56ba3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7292ddb9-c8c1-4ef1-ae77-397bdc226a6d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:28 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9cabb8-2930-4c16-a808-f2d917f4e94c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260]
Jul 25 15:43:28 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260] successful.
Jul 25 15:43:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[477cb11a-66c2-499a-942c-bd17669417e3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42a3c4a-b248-45d6-b643-742bb3ad5b01]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:29 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:29 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:29 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:29 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:29 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:29 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:29 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:29 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.040s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfdeab2-c1ca-45a0-ab11-f934c3370bc4]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtcHCblY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] Acquiring lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] Lock "be3bdffd-27ff-49a8-9aef-ddf374f33752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] No waiting events found dispatching network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:29 user nova-compute[70869]: WARNING nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received unexpected event network-vif-plugged-f71a78b3-ec67-4803-95e3-2490492edd10 for instance with vm_state deleted and task_state None.
Jul 25 15:43:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Received event network-vif-deleted-f71a78b3-ec67-4803-95e3-2490492edd10 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-unplugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] No waiting events found dispatching network-vif-unplugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:29 user nova-compute[70869]: WARNING nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received unexpected event network-vif-unplugged-110266bd-c366-4bb6-981f-608cfc13ab13 for instance with vm_state active and task_state reboot_started_hard.
Jul 25 15:43:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] No waiting events found dispatching network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:29 user nova-compute[70869]: WARNING nova.compute.manager [req-206a3c7a-886e-4510-8d06-f993ac8f0d58 req-f46b5f74-5521-4ea6-999c-f72cf19892cd service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received unexpected event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 for instance with vm_state active and task_state reboot_started_hard.
Jul 25 15:43:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23030396665623565', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030396665623565', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1969392480',display_name='tempest-TestMinimumBasicScenario-server-1969392480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1969392480',id=26,image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQgML7ATcFoxWxXjJc8agfkcR/GfGqrezO6JWItXGR4qsG0lUjNUHSBon21VdVXFvHrM1OdFDo7u7bX5JOxfW5DD+4X3WzLxSXlFymCahyF2wWw3cygbBT4zMhy49Dx6w==',key_name='tempest-TestMinimumBasicScenario-2020211488',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c07ad06e29c4d2dbe409fa13979b81b',ramdisk_id='',reservation_id='r-evznqodo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1773990321',owner_user_name='tempest-TestMinimumBasicScenario-1773990321-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:43:27Z,user_data=None,user_id='a905cee33a204704937a0224b3e6fab1',uuid=e69fa561-b002-49d7-8251-3de03ae44940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converting VIF {"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'pci_devices' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:43:30 user nova-compute[70869]:   <uuid>e69fa561-b002-49d7-8251-3de03ae44940</uuid>
Jul 25 15:43:30 user nova-compute[70869]:   <name>instance-0000001a</name>
Jul 25 15:43:30 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:43:30 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:43:30 user nova-compute[70869]:   <metadata>
Jul 25 15:43:30 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:43:30 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:43:30 user nova-compute[70869]:       <nova:name>tempest-TestMinimumBasicScenario-server-1969392480</nova:name>
Jul 25 15:43:30 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:43:28</nova:creationTime>
Jul 25 15:43:30 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:43:30 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:43:30 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:43:30 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:43:30 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:43:30 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:43:30 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:43:30 user nova-compute[70869]:       <nova:owner>
Jul 25 15:43:30 user nova-compute[70869]:         <nova:user uuid="a905cee33a204704937a0224b3e6fab1">tempest-TestMinimumBasicScenario-1773990321-project-member</nova:user>
Jul 25 15:43:30 user nova-compute[70869]:         <nova:project uuid="4c07ad06e29c4d2dbe409fa13979b81b">tempest-TestMinimumBasicScenario-1773990321</nova:project>
Jul 25 15:43:30 user nova-compute[70869]:       </nova:owner>
Jul 25 15:43:30 user nova-compute[70869]:       <nova:root type="image" uuid="ed132aaf-7487-4fae-8bce-0c773d559b1a"/>
Jul 25 15:43:30 user nova-compute[70869]:       <nova:ports>
Jul 25 15:43:30 user nova-compute[70869]:         <nova:port uuid="110266bd-c366-4bb6-981f-608cfc13ab13">
Jul 25 15:43:30 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 15:43:30 user nova-compute[70869]:         </nova:port>
Jul 25 15:43:30 user nova-compute[70869]:       </nova:ports>
Jul 25 15:43:30 user nova-compute[70869]:     </nova:instance>
Jul 25 15:43:30 user nova-compute[70869]:   </metadata>
Jul 25 15:43:30 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:43:30 user nova-compute[70869]:     <system>
Jul 25 15:43:30 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:43:30 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:43:30 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:43:30 user nova-compute[70869]:       <entry name="serial">e69fa561-b002-49d7-8251-3de03ae44940</entry>
Jul 25 15:43:30 user nova-compute[70869]:       <entry name="uuid">e69fa561-b002-49d7-8251-3de03ae44940</entry>
Jul 25 15:43:30 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:43:30 user nova-compute[70869]:     </system>
Jul 25 15:43:30 user nova-compute[70869]:   </sysinfo>
Jul 25 15:43:30 user nova-compute[70869]:   <os>
Jul 25 15:43:30 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:43:30 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:43:30 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:43:30 user nova-compute[70869]:   </os>
Jul 25 15:43:30 user nova-compute[70869]:   <features>
Jul 25 15:43:30 user nova-compute[70869]:     <acpi/>
Jul 25 15:43:30 user nova-compute[70869]:     <apic/>
Jul 25 15:43:30 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:43:30 user nova-compute[70869]:   </features>
Jul 25 15:43:30 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:43:30 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:43:30 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:43:30 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:43:30 user nova-compute[70869]:   </clock>
Jul 25 15:43:30 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:43:30 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:43:30 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:43:30 user nova-compute[70869]:   </cpu>
Jul 25 15:43:30 user nova-compute[70869]:   <devices>
Jul 25 15:43:30 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:43:30 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:43:30 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk"/>
Jul 25 15:43:30 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:43:30 user nova-compute[70869]:     </disk>
Jul 25 15:43:30 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:43:30 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:43:30 user nova-compute[70869]:       <source dev="/dev/sdd"/>
Jul 25 15:43:30 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:43:30 user nova-compute[70869]:       <serial>f0a05b0f-6e2b-4195-94d0-3414bbe8f31c</serial>
Jul 25 15:43:30 user nova-compute[70869]:     </disk>
Jul 25 15:43:30 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:43:30 user nova-compute[70869]:       <mac address="fa:16:3e:4a:f2:ce"/>
Jul 25 15:43:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:30 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:43:30 user nova-compute[70869]:       <target dev="tap110266bd-c3"/>
Jul 25 15:43:30 user nova-compute[70869]:     </interface>
Jul 25 15:43:30 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:43:30 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/console.log" append="off"/>
Jul 25 15:43:30 user nova-compute[70869]:     </serial>
Jul 25 15:43:30 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:43:30 user nova-compute[70869]:     <video>
Jul 25 15:43:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:30 user nova-compute[70869]:     </video>
Jul 25 15:43:30 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:43:30 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:43:30 user nova-compute[70869]:     </rng>
Jul 25 15:43:30 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:43:30 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:43:30 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:43:30 user nova-compute[70869]:     </memballoon>
Jul 25 15:43:30 user nova-compute[70869]:   </devices>
Jul 25 15:43:30 user nova-compute[70869]: </domain>
Jul 25 15:43:30 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'trusted_certs' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5 --force-share --output=json" returned: 0 in 0.218s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Cannot resize image /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:43:30 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'migration_context' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1969392480',display_name='tempest-TestMinimumBasicScenario-server-1969392480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1969392480',id=26,image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQgML7ATcFoxWxXjJc8agfkcR/GfGqrezO6JWItXGR4qsG0lUjNUHSBon21VdVXFvHrM1OdFDo7u7bX5JOxfW5DD+4X3WzLxSXlFymCahyF2wWw3cygbBT4zMhy49Dx6w==',key_name='tempest-TestMinimumBasicScenario-2020211488',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='4c07ad06e29c4d2dbe409fa13979b81b',ramdisk_id='',reservation_id='r-evznqodo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1773990321',owner_user_name='tempest-TestMinimumBasicScenario-1773990321-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:43:27Z,user_data=None,user_id='a905cee33a204704937a0224b3e6fab1',uuid=e69fa561-b002-49d7-8251-3de03ae44940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converting VIF {"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG os_vif [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap110266bd-c3, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap110266bd-c3, col_values=(('external_ids', {'iface-id': '110266bd-c366-4bb6-981f-608cfc13ab13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:f2:ce', 'vm-uuid': 'e69fa561-b002-49d7-8251-3de03ae44940'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:31 user nova-compute[70869]: INFO os_vif [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3')
Jul 25 15:43:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-8b876db5-b5e6-4f6b-a75b-7be786fedf2c req-cc97ea95-4f69-4020-8e9d-62a4d760d1df service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8b876db5-b5e6-4f6b-a75b-7be786fedf2c req-cc97ea95-4f69-4020-8e9d-62a4d760d1df service nova] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8b876db5-b5e6-4f6b-a75b-7be786fedf2c req-cc97ea95-4f69-4020-8e9d-62a4d760d1df service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8b876db5-b5e6-4f6b-a75b-7be786fedf2c req-cc97ea95-4f69-4020-8e9d-62a4d760d1df service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-8b876db5-b5e6-4f6b-a75b-7be786fedf2c req-cc97ea95-4f69-4020-8e9d-62a4d760d1df service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] No waiting events found dispatching network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:33 user nova-compute[70869]: WARNING nova.compute.manager [req-8b876db5-b5e6-4f6b-a75b-7be786fedf2c req-cc97ea95-4f69-4020-8e9d-62a4d760d1df service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received unexpected event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 for instance with vm_state active and task_state reboot_started_hard.
Jul 25 15:43:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:33 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:43:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Creating image(s)
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Ensure instance console log exists: /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Start _get_guest_xml network_info=[{"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f4e4b267-301a-43af-8bff-e09c3f57ef0c', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbIeNnLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58e838f4-a6e4-4292-a14a-f1e5894c615b', 'attached_at': '', 'detached_at': '', 'volume_id': '5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 'serial': '5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988'}, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:43:34 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:34 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbIeNnLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:43:34 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:34 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:34 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b5f2dc-b5a9-454d-a853-903df33ee0cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:43:34 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13a58fe-c607-451b-9714-a0e69bbb4844]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988] added
Jul 25 15:43:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[44542054-1d8c-412a-983c-2e9b52ee6bd8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f193c940-ca45-4ccd-80f3-955edc0791e3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbIeNnLG {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbIeNnLG" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[adafd6ce-b0fb-484b-8ab0-4963d3007a97]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PbIeNnLG'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab057bf9-69a3-420b-b1d4-35a6bd6d2cc0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updating instance_info_cache with network_info: [{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2f693-0fa6-4ba1-960b-d5f207f0c318]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquired lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'info_cache' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc9ffbe-5cab-48ec-8e71-55563e82fcb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988, portal: 172.16.0.220,3260]
Jul 25 15:43:34 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988, portal: 172.16.0.220,3260] successful.
Jul 25 15:43:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a122470e-eb8c-4748-b3e7-106471bb1ce4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b248bc60-2507-4ab9-ae88-b66416462ec0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:34 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:43:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdc9e48-03de-4555-88ec-1b26412caaa1]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbIeNnLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:43:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:35 user nova-compute[70869]: INFO nova.compute.manager [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Terminating instance
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-50606260-e0d1-42ba-8974-8d004a803951 req-7993972c-915d-4c1f-8f0b-8c05214d483e service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-50606260-e0d1-42ba-8974-8d004a803951 req-7993972c-915d-4c1f-8f0b-8c05214d483e service nova] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-50606260-e0d1-42ba-8974-8d004a803951 req-7993972c-915d-4c1f-8f0b-8c05214d483e service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-50606260-e0d1-42ba-8974-8d004a803951 req-7993972c-915d-4c1f-8f0b-8c05214d483e service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-50606260-e0d1-42ba-8974-8d004a803951 req-7993972c-915d-4c1f-8f0b-8c05214d483e service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] No waiting events found dispatching network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:35 user nova-compute[70869]: WARNING nova.compute.manager [req-50606260-e0d1-42ba-8974-8d004a803951 req-7993972c-915d-4c1f-8f0b-8c05214d483e service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received unexpected event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 for instance with vm_state active and task_state reboot_started_hard.
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for e69fa561-b002-49d7-8251-3de03ae44940 due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299815.3392527, e69fa561-b002-49d7-8251-3de03ae44940 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:35 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] VM Resumed (Lifecycle Event)
Jul 25 15:43:35 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Instance rebooted successfully.
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:35 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299815.3470602, e69fa561-b002-49d7-8251-3de03ae44940 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:35 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] VM Started (Lifecycle Event)
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0c31da1a-f98d-4c38-bcd5-5ccd6020c226 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.824s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updating instance_info_cache with network_info: [{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-06a22f54-bfb6-4e58-97d7-6a5abdc0dbb3 req-19c91c33-42bb-4ae9-b9ae-274a81f7b558 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received event network-vif-unplugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-06a22f54-bfb6-4e58-97d7-6a5abdc0dbb3 req-19c91c33-42bb-4ae9-b9ae-274a81f7b558 service nova] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-06a22f54-bfb6-4e58-97d7-6a5abdc0dbb3 req-19c91c33-42bb-4ae9-b9ae-274a81f7b558 service nova] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-06a22f54-bfb6-4e58-97d7-6a5abdc0dbb3 req-19c91c33-42bb-4ae9-b9ae-274a81f7b558 service nova] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-06a22f54-bfb6-4e58-97d7-6a5abdc0dbb3 req-19c91c33-42bb-4ae9-b9ae-274a81f7b558 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] No waiting events found dispatching network-vif-unplugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-06a22f54-bfb6-4e58-97d7-6a5abdc0dbb3 req-19c91c33-42bb-4ae9-b9ae-274a81f7b558 service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received event network-vif-unplugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Releasing lock "refresh_cache-00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:35 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance destroyed successfully.
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'resources' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1782526812',display_name='tempest-AttachVolumeTestJSON-server-1782526812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1782526812',id=17,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgx4fq1cT4MygBGosJgP3XPSWGKF3gnduqEAFmLa+F0YVFSQUPKLO96fGYOHT8HxxGd6r8xcuaJXn2eA+U3LK/s80eGJrh+hSaGuqjT1BrCFhcZworBSoltLMzly4CBDw==',key_name='tempest-keypair-660713528',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-3lkej28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=00d20ec6-9f55-42f9-b4ed-6c02c9ac390f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG os_vif [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd545db2f-02, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: INFO os_vif [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02')
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Start _get_guest_xml network_info=[{"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'numa_topology' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '23934336436376633', 'path': '/dev/sdg'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934336436376633', 'path': '/dev/sdg'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:43:35 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:35 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-641923212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-641923212',id=28,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-6itgyw2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:43:19Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=58e838f4-a6e4-4292-a14a-f1e5894c615b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b4:8c,bridge_name='br-int',has_traffic_filtering=True,id=8624ca7f-ed89-4043-8c98-806cdf440681,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624ca7f-ed') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'pci_devices' on Instance uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1782526812',display_name='tempest-AttachVolumeTestJSON-server-1782526812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1782526812',id=17,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgx4fq1cT4MygBGosJgP3XPSWGKF3gnduqEAFmLa+F0YVFSQUPKLO96fGYOHT8HxxGd6r8xcuaJXn2eA+U3LK/s80eGJrh+hSaGuqjT1BrCFhcZworBSoltLMzly4CBDw==',key_name='tempest-keypair-660713528',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-3lkej28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=00d20ec6-9f55-42f9-b4ed-6c02c9ac390f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'pci_devices' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:43:35 user nova-compute[70869]:   <uuid>58e838f4-a6e4-4292-a14a-f1e5894c615b</uuid>
Jul 25 15:43:35 user nova-compute[70869]:   <name>instance-0000001c</name>
Jul 25 15:43:35 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:43:35 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:43:35 user nova-compute[70869]:   <metadata>
Jul 25 15:43:35 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:43:35 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-641923212</nova:name>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:43:34</nova:creationTime>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:43:35 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:43:35 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:owner>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:user uuid="02dfa618b8fc4b06b5e396b7da9e8443">tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member</nova:user>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:project uuid="3735c3192f424a8abee7c1874609f005">tempest-ServerBootFromVolumeStableRescueTest-508290498</nova:project>
Jul 25 15:43:35 user nova-compute[70869]:       </nova:owner>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:ports>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:port uuid="8624ca7f-ed89-4043-8c98-806cdf440681">
Jul 25 15:43:35 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 15:43:35 user nova-compute[70869]:         </nova:port>
Jul 25 15:43:35 user nova-compute[70869]:       </nova:ports>
Jul 25 15:43:35 user nova-compute[70869]:     </nova:instance>
Jul 25 15:43:35 user nova-compute[70869]:   </metadata>
Jul 25 15:43:35 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:43:35 user nova-compute[70869]:     <system>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="serial">58e838f4-a6e4-4292-a14a-f1e5894c615b</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="uuid">58e838f4-a6e4-4292-a14a-f1e5894c615b</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:43:35 user nova-compute[70869]:     </system>
Jul 25 15:43:35 user nova-compute[70869]:   </sysinfo>
Jul 25 15:43:35 user nova-compute[70869]:   <os>
Jul 25 15:43:35 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:43:35 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:43:35 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:43:35 user nova-compute[70869]:   </os>
Jul 25 15:43:35 user nova-compute[70869]:   <features>
Jul 25 15:43:35 user nova-compute[70869]:     <acpi/>
Jul 25 15:43:35 user nova-compute[70869]:     <apic/>
Jul 25 15:43:35 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:43:35 user nova-compute[70869]:   </features>
Jul 25 15:43:35 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:43:35 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:43:35 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:43:35 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:43:35 user nova-compute[70869]:   </clock>
Jul 25 15:43:35 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:43:35 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:43:35 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:43:35 user nova-compute[70869]:   </cpu>
Jul 25 15:43:35 user nova-compute[70869]:   <devices>
Jul 25 15:43:35 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:43:35 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:43:35 user nova-compute[70869]:       <source dev="/dev/sdg"/>
Jul 25 15:43:35 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:43:35 user nova-compute[70869]:       <serial>5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988</serial>
Jul 25 15:43:35 user nova-compute[70869]:     </disk>
Jul 25 15:43:35 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:43:35 user nova-compute[70869]:       <mac address="fa:16:3e:6b:b4:8c"/>
Jul 25 15:43:35 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:35 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:43:35 user nova-compute[70869]:       <target dev="tap8624ca7f-ed"/>
Jul 25 15:43:35 user nova-compute[70869]:     </interface>
Jul 25 15:43:35 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:43:35 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/console.log" append="off"/>
Jul 25 15:43:35 user nova-compute[70869]:     </serial>
Jul 25 15:43:35 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:43:35 user nova-compute[70869]:     <video>
Jul 25 15:43:35 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:35 user nova-compute[70869]:     </video>
Jul 25 15:43:35 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:43:35 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:43:35 user nova-compute[70869]:     </rng>
Jul 25 15:43:35 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:43:35 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:43:35 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:43:35 user nova-compute[70869]:     </memballoon>
Jul 25 15:43:35 user nova-compute[70869]:   </devices>
Jul 25 15:43:35 user nova-compute[70869]: </domain>
Jul 25 15:43:35 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-641923212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-641923212',id=28,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-6itgyw2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:43:19Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=58e838f4-a6e4-4292-a14a-f1e5894c615b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b4:8c,bridge_name='br-int',has_traffic_filtering=True,id=8624ca7f-ed89-4043-8c98-806cdf440681,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624ca7f-ed') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG os_vif [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b4:8c,bridge_name='br-int',has_traffic_filtering=True,id=8624ca7f-ed89-4043-8c98-806cdf440681,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624ca7f-ed') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:43:35 user nova-compute[70869]:   <uuid>00d20ec6-9f55-42f9-b4ed-6c02c9ac390f</uuid>
Jul 25 15:43:35 user nova-compute[70869]:   <name>instance-00000011</name>
Jul 25 15:43:35 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:43:35 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:43:35 user nova-compute[70869]:   <metadata>
Jul 25 15:43:35 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:43:35 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeTestJSON-server-1782526812</nova:name>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:43:35</nova:creationTime>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:43:35 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:43:35 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:owner>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:user uuid="3d528e01a08f40d4b598ab8222c2edf5">tempest-AttachVolumeTestJSON-512738646-project-member</nova:user>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:project uuid="d2f5d520a39742c69302f96795d0ea61">tempest-AttachVolumeTestJSON-512738646</nova:project>
Jul 25 15:43:35 user nova-compute[70869]:       </nova:owner>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:43:35 user nova-compute[70869]:       <nova:ports>
Jul 25 15:43:35 user nova-compute[70869]:         <nova:port uuid="d545db2f-0230-400f-9bcd-e3db63ade6b6">
Jul 25 15:43:35 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 15:43:35 user nova-compute[70869]:         </nova:port>
Jul 25 15:43:35 user nova-compute[70869]:       </nova:ports>
Jul 25 15:43:35 user nova-compute[70869]:     </nova:instance>
Jul 25 15:43:35 user nova-compute[70869]:   </metadata>
Jul 25 15:43:35 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:43:35 user nova-compute[70869]:     <system>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="serial">00d20ec6-9f55-42f9-b4ed-6c02c9ac390f</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="uuid">00d20ec6-9f55-42f9-b4ed-6c02c9ac390f</entry>
Jul 25 15:43:35 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:43:35 user nova-compute[70869]:     </system>
Jul 25 15:43:35 user nova-compute[70869]:   </sysinfo>
Jul 25 15:43:35 user nova-compute[70869]:   <os>
Jul 25 15:43:35 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:43:35 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:43:35 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:43:35 user nova-compute[70869]:   </os>
Jul 25 15:43:35 user nova-compute[70869]:   <features>
Jul 25 15:43:35 user nova-compute[70869]:     <acpi/>
Jul 25 15:43:35 user nova-compute[70869]:     <apic/>
Jul 25 15:43:35 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:43:35 user nova-compute[70869]:   </features>
Jul 25 15:43:35 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:43:35 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:43:35 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:43:35 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:43:35 user nova-compute[70869]:   </clock>
Jul 25 15:43:35 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:43:35 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:43:35 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:43:35 user nova-compute[70869]:   </cpu>
Jul 25 15:43:35 user nova-compute[70869]:   <devices>
Jul 25 15:43:35 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:43:35 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:43:35 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk"/>
Jul 25 15:43:35 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:43:35 user nova-compute[70869]:     </disk>
Jul 25 15:43:35 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:43:35 user nova-compute[70869]:       <mac address="fa:16:3e:de:f6:f9"/>
Jul 25 15:43:35 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:35 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:43:35 user nova-compute[70869]:       <target dev="tapd545db2f-02"/>
Jul 25 15:43:35 user nova-compute[70869]:     </interface>
Jul 25 15:43:35 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:43:35 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/console.log" append="off"/>
Jul 25 15:43:35 user nova-compute[70869]:     </serial>
Jul 25 15:43:35 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:43:35 user nova-compute[70869]:     <video>
Jul 25 15:43:35 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:35 user nova-compute[70869]:     </video>
Jul 25 15:43:35 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:43:35 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:43:35 user nova-compute[70869]:     </rng>
Jul 25 15:43:35 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:43:35 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:43:35 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:43:35 user nova-compute[70869]:     </memballoon>
Jul 25 15:43:35 user nova-compute[70869]:   </devices>
Jul 25 15:43:35 user nova-compute[70869]: </domain>
Jul 25 15:43:35 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8624ca7f-ed, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8624ca7f-ed, col_values=(('external_ids', {'iface-id': '8624ca7f-ed89-4043-8c98-806cdf440681', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:b4:8c', 'vm-uuid': '58e838f4-a6e4-4292-a14a-f1e5894c615b'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:35 user nova-compute[70869]: INFO os_vif [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b4:8c,bridge_name='br-int',has_traffic_filtering=True,id=8624ca7f-ed89-4043-8c98-806cdf440681,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624ca7f-ed')
Jul 25 15:43:36 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Instance destroyed successfully.
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lazy-loading 'resources' on Instance uuid bb780430-2cb6-4443-98ed-a224ec35bf57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-488941019',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-488941019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4889410',id=24,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5d8ZdlciBeyMe6OqXEga3f3YZAnht5P0bMIBMe94uZfthXsjOIv4c08c5TYTP9Zv97glL3vNhINKZ9W4QjTBCxNBnCPos/wPh07y2upQLGhpPU5ZhLmxwWyTIz9fZfxA==',key_name='tempest-keypair-1542122477',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8586c0f069de4002b5d51cb402692ed2',ramdisk_id='',reservation_id='r-himxzeoc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-643770885',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5d92c004234431fbeb875c789149c02',uuid=bb780430-2cb6-4443-98ed-a224ec35bf57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Converting VIF {"id": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "address": "fa:16:3e:4d:b5:bd", "network": {"id": "9914bb6f-e17c-4505-93bf-dbb3b7f55e78", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868521701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8586c0f069de4002b5d51cb402692ed2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bb2f13a-02", "ovs_interfaceid": "3bb2f13a-02b4-4872-8b2c-dfb23be94ba1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b5:bd,bridge_name='br-int',has_traffic_filtering=True,id=3bb2f13a-02b4-4872-8b2c-dfb23be94ba1,network=Network(9914bb6f-e17c-4505-93bf-dbb3b7f55e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb2f13a-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG os_vif [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b5:bd,bridge_name='br-int',has_traffic_filtering=True,id=3bb2f13a-02b4-4872-8b2c-dfb23be94ba1,network=Network(9914bb6f-e17c-4505-93bf-dbb3b7f55e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb2f13a-02') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bb2f13a-02, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No VIF found with MAC fa:16:3e:6b:b4:8c, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:43:36 user nova-compute[70869]: INFO os_vif [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b5:bd,bridge_name='br-int',has_traffic_filtering=True,id=3bb2f13a-02b4-4872-8b2c-dfb23be94ba1,network=Network(9914bb6f-e17c-4505-93bf-dbb3b7f55e78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bb2f13a-02')
Jul 25 15:43:36 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Deleting instance files /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57_del
Jul 25 15:43:36 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Deletion of /opt/stack/data/nova/instances/bb780430-2cb6-4443-98ed-a224ec35bf57_del complete
Jul 25 15:43:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:36 user nova-compute[70869]: INFO nova.compute.manager [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 25 15:43:36 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.178s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Cannot resize image /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'migration_context' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1782526812',display_name='tempest-AttachVolumeTestJSON-server-1782526812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1782526812',id=17,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgx4fq1cT4MygBGosJgP3XPSWGKF3gnduqEAFmLa+F0YVFSQUPKLO96fGYOHT8HxxGd6r8xcuaJXn2eA+U3LK/s80eGJrh+hSaGuqjT1BrCFhcZworBSoltLMzly4CBDw==',key_name='tempest-keypair-660713528',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-3lkej28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=00d20ec6-9f55-42f9-b4ed-6c02c9ac390f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG os_vif [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd545db2f-02, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd545db2f-02, col_values=(('external_ids', {'iface-id': 'd545db2f-0230-400f-9bcd-e3db63ade6b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:f6:f9', 'vm-uuid': '00d20ec6-9f55-42f9-b4ed-6c02c9ac390f'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:36 user nova-compute[70869]: INFO os_vif [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02')
Jul 25 15:43:36 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:37 user nova-compute[70869]: INFO nova.compute.manager [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Terminating instance
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-72f758b6-4cde-4dd2-b98f-d9975f2ded8d req-0fdb128c-c5a3-4035-9bc5-d1dc44d630cd service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-changed-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-72f758b6-4cde-4dd2-b98f-d9975f2ded8d req-0fdb128c-c5a3-4035-9bc5-d1dc44d630cd service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Refreshing instance network info cache due to event network-changed-dc8120e3-6fb4-438a-94a3-7cbb36406ebd. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72f758b6-4cde-4dd2-b98f-d9975f2ded8d req-0fdb128c-c5a3-4035-9bc5-d1dc44d630cd service nova] Acquiring lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72f758b6-4cde-4dd2-b98f-d9975f2ded8d req-0fdb128c-c5a3-4035-9bc5-d1dc44d630cd service nova] Acquired lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-72f758b6-4cde-4dd2-b98f-d9975f2ded8d req-0fdb128c-c5a3-4035-9bc5-d1dc44d630cd service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Refreshing network info cache for port dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received event network-vif-plugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] Acquiring lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] No waiting events found dispatching network-vif-plugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:37 user nova-compute[70869]: WARNING nova.compute.manager [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received unexpected event network-vif-plugged-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 for instance with vm_state active and task_state deleting.
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-changed-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing instance network info cache due to event network-changed-685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] Acquiring lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] Acquired lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Refreshing network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-72f758b6-4cde-4dd2-b98f-d9975f2ded8d req-0fdb128c-c5a3-4035-9bc5-d1dc44d630cd service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updated VIF entry in instance network info cache for port dc8120e3-6fb4-438a-94a3-7cbb36406ebd. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:43:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-72f758b6-4cde-4dd2-b98f-d9975f2ded8d req-0fdb128c-c5a3-4035-9bc5-d1dc44d630cd service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating instance_info_cache with network_info: [{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72f758b6-4cde-4dd2-b98f-d9975f2ded8d req-0fdb128c-c5a3-4035-9bc5-d1dc44d630cd service nova] Releasing lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:38 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Took 2.27 seconds to deallocate network for instance.
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:38 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Instance destroyed successfully.
Jul 25 15:43:38 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lazy-loading 'resources' on Instance uuid 4d9706b8-2a69-4272-89d3-f8a985e0ad2c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1120590963',display_name='tempest-TestShelveInstance-server-1120590963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1120590963',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIgLtUd6WGXmr6U7WthLqyhjTgPJ8c1kY/GE2MVvAA0fdKsiMoEQPcMEldthR7JieY77CD1/uKZkLQ4DWjjCVjLUomINTCZvIG2NVvpOQd+8k106ZkJRPzkRSKmT72jPg==',key_name='tempest-TestShelveInstance-1341964134',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77781f71b0364014b1561b8158656565',ramdisk_id='',reservation_id='r-ax0saf22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2115421608',owner_user_name='tempest-TestShelveInstance-2115421608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:42:01Z,user_data=None,user_id='6af1342ac93849d995a457cde23bde41',uuid=4d9706b8-2a69-4272-89d3-f8a985e0ad2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converting VIF {"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_vif [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap685fa69b-6f, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG nova.network.neutron [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updated VIF entry in instance network info cache for port 685fa69b-6fa0-4620-8367-c7363215995c. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG nova.network.neutron [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating instance_info_cache with network_info: [{"id": "685fa69b-6fa0-4620-8367-c7363215995c", "address": "fa:16:3e:5a:61:d5", "network": {"id": "1f8b59f0-272d-4e75-8f9e-c5bde4756a78", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146677850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77781f71b0364014b1561b8158656565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685fa69b-6f", "ovs_interfaceid": "685fa69b-6fa0-4620-8367-c7363215995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3a74a95-9b60-47a3-9284-ec7df7d6eee4 req-20d52f17-58a1-4dcc-b00d-ea4dcc13857c service nova] Releasing lock "refresh_cache-4d9706b8-2a69-4272-89d3-f8a985e0ad2c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:38 user nova-compute[70869]: INFO os_vif [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:61:d5,bridge_name='br-int',has_traffic_filtering=True,id=685fa69b-6fa0-4620-8367-c7363215995c,network=Network(1f8b59f0-272d-4e75-8f9e-c5bde4756a78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685fa69b-6f')
Jul 25 15:43:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNljCLFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:43:38 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb61663-9f51-4358-a9b2-b36a24e5da67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:43:38 user nova-compute[70869]: No targets found.
Jul 25 15:43:38 user nova-compute[70869]: iSNS:
Jul 25 15:43:38 user nova-compute[70869]: No targets found.
Jul 25 15:43:38 user nova-compute[70869]: STATIC:
Jul 25 15:43:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:43:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:43:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c
Jul 25 15:43:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:43:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:43:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:38 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a
Jul 25 15:43:38 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:43:38 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:43:38 user nova-compute[70869]: FIRMWARE:
Jul 25 15:43:38 user nova-compute[70869]: No targets found.
Jul 25 15:43:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:43:38 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:43:38 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c54bcc-a48b-4b4f-a230-40f9aa651da2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e26c5b3-9679-4bb3-8358-8383fa6c0fd5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:43:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:43:38 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:43:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c150ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf80f00-4447-4a1c-b76e-3e499cfea47a]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd0ce81-3b3a-4c96-b230-165e7dab7423]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df68bda-0a2a-4234-8337-36b82e7cad59]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:43:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.086s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ccf4e7-5383-424c-b971-ec2d10a8ec49]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f620503e-fa7a-45ae-a293-6b28187ae4be]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[339ff6ad-1fd7-4c00-8bd1-2387beb94c54]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260]
Jul 25 15:43:39 user nova-compute[70869]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a, portal: 172.16.0.220,3260] successful.
Jul 25 15:43:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd3a4fb-7d3b-4cbc-a399-8aa59081943a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[561f7b61-aca0-4608-a18f-bdf7b8b22ec7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.474s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] <== disconnect_volume: return (476ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:43:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Deleting instance files /opt/stack/data/nova/instances/4d9706b8-2a69-4272-89d3-f8a985e0ad2c_del
Jul 25 15:43:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Deletion of /opt/stack/data/nova/instances/4d9706b8-2a69-4272-89d3-f8a985e0ad2c_del complete
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299804.3552032, be3bdffd-27ff-49a8-9aef-ddf374f33752 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:39 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] VM Stopped (Lifecycle Event)
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.707s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-fe84bdf0-0074-4845-9439-73851c766afa None None] [instance: be3bdffd-27ff-49a8-9aef-ddf374f33752] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-3dcfff2d-2ab4-4be1-83d6-7b104039e3b8 req-e4ca0829-b01f-4fc5-897f-aac2f9c2990b service nova] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Received event network-vif-deleted-3bb2f13a-02b4-4872-8b2c-dfb23be94ba1 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:39 user nova-compute[70869]: INFO nova.compute.manager [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Took 2.22 seconds to destroy the instance on the hypervisor.
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:43:39 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Deleted allocations for instance bb780430-2cb6-4443-98ed-a224ec35bf57
Jul 25 15:43:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87b11f14-ebc0-4132-b5e7-8d90bee19bd7 tempest-TestServerVolumeAttachScenarioOldVersion-643770885 tempest-TestServerVolumeAttachScenarioOldVersion-643770885-project-member] Lock "bb780430-2cb6-4443-98ed-a224ec35bf57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.433s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-unplugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] No waiting events found dispatching network-vif-unplugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-unplugged-685fa69b-6fa0-4620-8367-c7363215995c for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] Acquiring lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] No waiting events found dispatching network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:39 user nova-compute[70869]: WARNING nova.compute.manager [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received unexpected event network-vif-plugged-685fa69b-6fa0-4620-8367-c7363215995c for instance with vm_state active and task_state deleting.
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:39 user nova-compute[70869]: WARNING nova.compute.manager [req-72c2c937-8132-4868-a960-0ed5daf5391f req-54e9cf89-d4ab-4efe-9b7c-92c1d134b112 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state building and task_state spawning.
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:40 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:43:40 user nova-compute[70869]: INFO nova.compute.claims [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Claim successful on node user
Jul 25 15:43:40 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:40 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Took 0.85 seconds to deallocate network for instance.
Jul 25 15:43:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:40 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:43:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:40 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.006s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.network.neutron [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:43:41 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.policy [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ff326f1daa2470ba2a9825cba1a6cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824a047d86a145cfb65e2670b67f772e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:43:41 user nova-compute[70869]: INFO nova.compute.manager [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Took 1.07 seconds to detach 1 volumes for instance.
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Deleting volume: abd3a4fb-7d3b-4cbc-a399-8aa59081943a {{(pid=70869) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:43:41 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Creating image(s)
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "/opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "/opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-e386eff9-34ec-4598-a096-27a93a724e11 req-fa16dc07-9ba8-49f3-ad73-914b45dfaaf8 service nova] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Received event network-vif-deleted-685fa69b-6fa0-4620-8367-c7363215995c {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.194s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.166s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk 1073741824" returned: 0 in 0.065s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:41 user nova-compute[70869]: WARNING nova.compute.manager [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state building and task_state spawning.
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:41 user nova-compute[70869]: WARNING nova.compute.manager [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state stopped and task_state powering-on.
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:41 user nova-compute[70869]: WARNING nova.compute.manager [req-9c503cce-cc87-4eee-b469-e14be4c06744 req-60ff2f04-6246-48e9-aeb0-4c78278a8108 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state stopped and task_state powering-on.
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:43:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.170s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Cannot resize image /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'migration_context' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Ensure instance console log exists: /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.network.neutron [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Successfully created port: 839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299822.4773452, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] VM Resumed (Lifecycle Event)
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance rebooted successfully.
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-18264df0-5869-40a7-8433-7f9057082163 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Instance spawned successfully.
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Shelving
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.066s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299822.489133, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] VM Started (Lifecycle Event)
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Deleted allocations for instance 4d9706b8-2a69-4272-89d3-f8a985e0ad2c
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299822.491231, 58e838f4-a6e4-4292-a14a-f1e5894c615b => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] VM Resumed (Lifecycle Event)
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Took 8.56 seconds to spawn the instance on the hypervisor.
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c5d188d-5499-4097-9044-acdc803660ad tempest-TestShelveInstance-2115421608 tempest-TestShelveInstance-2115421608-project-member] Lock "4d9706b8-2a69-4272-89d3-f8a985e0ad2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.655s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299822.4913876, 58e838f4-a6e4-4292-a14a-f1e5894c615b => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] VM Started (Lifecycle Event)
Jul 25 15:43:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:43:42 user nova-compute[70869]: INFO nova.compute.manager [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Took 24.99 seconds to build instance.
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5594f7b0-5f11-4b1c-b474-affd00071d52 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.188s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:43:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance destroyed successfully.
Jul 25 15:43:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.network.neutron [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Successfully updated port: 839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-37b90463-cb90-443d-a7b5-77c3c4fb78fc req-d811e503-0661-4bc5-ae06-27505d8fde41 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received event network-changed-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-37b90463-cb90-443d-a7b5-77c3c4fb78fc req-d811e503-0661-4bc5-ae06-27505d8fde41 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Refreshing instance network info cache due to event network-changed-839092bd-bc94-4891-b50c-a9cb6ae791f4. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-37b90463-cb90-443d-a7b5-77c3c4fb78fc req-d811e503-0661-4bc5-ae06-27505d8fde41 service nova] Acquiring lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-37b90463-cb90-443d-a7b5-77c3c4fb78fc req-d811e503-0661-4bc5-ae06-27505d8fde41 service nova] Acquired lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-37b90463-cb90-443d-a7b5-77c3c4fb78fc req-d811e503-0661-4bc5-ae06-27505d8fde41 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Refreshing network info cache for port 839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-49a3bf34-686a-487d-bc83-aba8f621e539 req-b3a9beff-84f3-43e0-9d21-cac6703e44d8 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-unplugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-49a3bf34-686a-487d-bc83-aba8f621e539 req-b3a9beff-84f3-43e0-9d21-cac6703e44d8 service nova] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-49a3bf34-686a-487d-bc83-aba8f621e539 req-b3a9beff-84f3-43e0-9d21-cac6703e44d8 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-49a3bf34-686a-487d-bc83-aba8f621e539 req-b3a9beff-84f3-43e0-9d21-cac6703e44d8 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-49a3bf34-686a-487d-bc83-aba8f621e539 req-b3a9beff-84f3-43e0-9d21-cac6703e44d8 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] No waiting events found dispatching network-vif-unplugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:44 user nova-compute[70869]: WARNING nova.compute.manager [req-49a3bf34-686a-487d-bc83-aba8f621e539 req-b3a9beff-84f3-43e0-9d21-cac6703e44d8 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received unexpected event network-vif-unplugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd for instance with vm_state active and task_state shelving.
Jul 25 15:43:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:44 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:44 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7529MB free_disk=25.395404815673828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Beginning cold snapshot process
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-37b90463-cb90-443d-a7b5-77c3c4fb78fc req-d811e503-0661-4bc5-ae06-27505d8fde41 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Applying migration context for instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f as it has an incoming, in-progress migration 7b143170-c785-4a8c-a5d5-85471ab4fb59. Migration status is finished {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 25 15:43:44 user nova-compute[70869]: INFO nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating resource usage from migration 7b143170-c785-4a8c-a5d5-85471ab4fb59
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e69fa561-b002-49d7-8251-3de03ae44940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d384e3b6-8948-4db0-8d39-a340cb130c57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bba84347-9d28-4789-8d45-3e39770c8f4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Migration 7b143170-c785-4a8c-a5d5-85471ab4fb59 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 58e838f4-a6e4-4292-a14a-f1e5894c615b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a7211b55-7b3f-455b-b185-4e6432faf006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk /opt/stack/data/nova/instances/snapshots/tmp1sqx8f6o/8c487d65fa7741a9bb81b556bdebc6d8 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-37b90463-cb90-443d-a7b5-77c3c4fb78fc req-d811e503-0661-4bc5-ae06-27505d8fde41 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-37b90463-cb90-443d-a7b5-77c3c4fb78fc req-d811e503-0661-4bc5-ae06-27505d8fde41 service nova] Releasing lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquired lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.network.neutron [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:43:44 user nova-compute[70869]: DEBUG nova.network.neutron [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.network.neutron [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating instance_info_cache with network_info: [{"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Releasing lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Instance network_info: |[{"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Start _get_guest_xml network_info=[{"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:43:45 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:45 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2116910533',display_name='tempest-SnapshotDataIntegrityTests-server-2116910533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2116910533',id=29,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/oofr1ZxBQwScPmsOuwrv8RwvrNED/HxuubeCk2vqKoUhZf79IJOmqxHvko1JE4AmKT+5e1P2pw2S6yxrsF+zMixxoiGwblM7AqXTnaHJuajyEOOM2EcOTx/dDSS7Nng==',key_name='tempest-keypair-1493508955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='824a047d86a145cfb65e2670b67f772e',ramdisk_id='',reservation_id='r-yuoszavx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1575215574',owner_user_name='tempest-SnapshotDataIntegrityTests-1575215574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:43:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ff326f1daa2470ba2a9825cba1a6cbd',uuid=a7211b55-7b3f-455b-b185-4e6432faf006,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Converting VIF {"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=839092bd-bc94-4891-b50c-a9cb6ae791f4,network=Network(cacef9c3-a484-4d84-bb86-741e35a384ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839092bd-bc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.objects.instance [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'pci_devices' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.116s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:43:45 user nova-compute[70869]:   <uuid>a7211b55-7b3f-455b-b185-4e6432faf006</uuid>
Jul 25 15:43:45 user nova-compute[70869]:   <name>instance-0000001d</name>
Jul 25 15:43:45 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:43:45 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:43:45 user nova-compute[70869]:   <metadata>
Jul 25 15:43:45 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:43:45 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:43:45 user nova-compute[70869]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2116910533</nova:name>
Jul 25 15:43:45 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:43:45</nova:creationTime>
Jul 25 15:43:45 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:43:45 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:43:45 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:43:45 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:43:45 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:43:45 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:43:45 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:43:45 user nova-compute[70869]:       <nova:owner>
Jul 25 15:43:45 user nova-compute[70869]:         <nova:user uuid="6ff326f1daa2470ba2a9825cba1a6cbd">tempest-SnapshotDataIntegrityTests-1575215574-project-member</nova:user>
Jul 25 15:43:45 user nova-compute[70869]:         <nova:project uuid="824a047d86a145cfb65e2670b67f772e">tempest-SnapshotDataIntegrityTests-1575215574</nova:project>
Jul 25 15:43:45 user nova-compute[70869]:       </nova:owner>
Jul 25 15:43:45 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:43:45 user nova-compute[70869]:       <nova:ports>
Jul 25 15:43:45 user nova-compute[70869]:         <nova:port uuid="839092bd-bc94-4891-b50c-a9cb6ae791f4">
Jul 25 15:43:45 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 15:43:45 user nova-compute[70869]:         </nova:port>
Jul 25 15:43:45 user nova-compute[70869]:       </nova:ports>
Jul 25 15:43:45 user nova-compute[70869]:     </nova:instance>
Jul 25 15:43:45 user nova-compute[70869]:   </metadata>
Jul 25 15:43:45 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:43:45 user nova-compute[70869]:     <system>
Jul 25 15:43:45 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:43:45 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:43:45 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:43:45 user nova-compute[70869]:       <entry name="serial">a7211b55-7b3f-455b-b185-4e6432faf006</entry>
Jul 25 15:43:45 user nova-compute[70869]:       <entry name="uuid">a7211b55-7b3f-455b-b185-4e6432faf006</entry>
Jul 25 15:43:45 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:43:45 user nova-compute[70869]:     </system>
Jul 25 15:43:45 user nova-compute[70869]:   </sysinfo>
Jul 25 15:43:45 user nova-compute[70869]:   <os>
Jul 25 15:43:45 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:43:45 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:43:45 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:43:45 user nova-compute[70869]:   </os>
Jul 25 15:43:45 user nova-compute[70869]:   <features>
Jul 25 15:43:45 user nova-compute[70869]:     <acpi/>
Jul 25 15:43:45 user nova-compute[70869]:     <apic/>
Jul 25 15:43:45 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:43:45 user nova-compute[70869]:   </features>
Jul 25 15:43:45 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:43:45 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:43:45 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:43:45 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:43:45 user nova-compute[70869]:   </clock>
Jul 25 15:43:45 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:43:45 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:43:45 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:43:45 user nova-compute[70869]:   </cpu>
Jul 25 15:43:45 user nova-compute[70869]:   <devices>
Jul 25 15:43:45 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:43:45 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:43:45 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk"/>
Jul 25 15:43:45 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:43:45 user nova-compute[70869]:     </disk>
Jul 25 15:43:45 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:43:45 user nova-compute[70869]:       <mac address="fa:16:3e:10:17:8d"/>
Jul 25 15:43:45 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:45 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:43:45 user nova-compute[70869]:       <target dev="tap839092bd-bc"/>
Jul 25 15:43:45 user nova-compute[70869]:     </interface>
Jul 25 15:43:45 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:43:45 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/console.log" append="off"/>
Jul 25 15:43:45 user nova-compute[70869]:     </serial>
Jul 25 15:43:45 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:43:45 user nova-compute[70869]:     <video>
Jul 25 15:43:45 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:43:45 user nova-compute[70869]:     </video>
Jul 25 15:43:45 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:43:45 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:43:45 user nova-compute[70869]:     </rng>
Jul 25 15:43:45 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:43:45 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:43:45 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:43:45 user nova-compute[70869]:     </memballoon>
Jul 25 15:43:45 user nova-compute[70869]:   </devices>
Jul 25 15:43:45 user nova-compute[70869]: </domain>
Jul 25 15:43:45 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2116910533',display_name='tempest-SnapshotDataIntegrityTests-server-2116910533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2116910533',id=29,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/oofr1ZxBQwScPmsOuwrv8RwvrNED/HxuubeCk2vqKoUhZf79IJOmqxHvko1JE4AmKT+5e1P2pw2S6yxrsF+zMixxoiGwblM7AqXTnaHJuajyEOOM2EcOTx/dDSS7Nng==',key_name='tempest-keypair-1493508955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='824a047d86a145cfb65e2670b67f772e',ramdisk_id='',reservation_id='r-yuoszavx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1575215574',owner_user_name='tempest-SnapshotDataIntegrityTests-1575215574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:43:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ff326f1daa2470ba2a9825cba1a6cbd',uuid=a7211b55-7b3f-455b-b185-4e6432faf006,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Converting VIF {"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=839092bd-bc94-4891-b50c-a9cb6ae791f4,network=Network(cacef9c3-a484-4d84-bb86-741e35a384ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839092bd-bc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG os_vif [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=839092bd-bc94-4891-b50c-a9cb6ae791f4,network=Network(cacef9c3-a484-4d84-bb86-741e35a384ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839092bd-bc') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap839092bd-bc, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap839092bd-bc, col_values=(('external_ids', {'iface-id': '839092bd-bc94-4891-b50c-a9cb6ae791f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:17:8d', 'vm-uuid': 'a7211b55-7b3f-455b-b185-4e6432faf006'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:45 user nova-compute[70869]: INFO os_vif [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=839092bd-bc94-4891-b50c-a9cb6ae791f4,network=Network(cacef9c3-a484-4d84-bb86-741e35a384ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839092bd-bc')
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No VIF found with MAC fa:16:3e:10:17:8d, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk /opt/stack/data/nova/instances/snapshots/tmp1sqx8f6o/8c487d65fa7741a9bb81b556bdebc6d8" returned: 0 in 1.120s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:43:45 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Snapshot extracted, beginning image upload
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-33d43635-1a15-4afc-b9ae-8a20ebea722f req-6da3b560-4d2f-499f-aa00-82c2bb460837 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-33d43635-1a15-4afc-b9ae-8a20ebea722f req-6da3b560-4d2f-499f-aa00-82c2bb460837 service nova] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-33d43635-1a15-4afc-b9ae-8a20ebea722f req-6da3b560-4d2f-499f-aa00-82c2bb460837 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-33d43635-1a15-4afc-b9ae-8a20ebea722f req-6da3b560-4d2f-499f-aa00-82c2bb460837 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-33d43635-1a15-4afc-b9ae-8a20ebea722f req-6da3b560-4d2f-499f-aa00-82c2bb460837 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] No waiting events found dispatching network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:45 user nova-compute[70869]: WARNING nova.compute.manager [req-33d43635-1a15-4afc-b9ae-8a20ebea722f req-6da3b560-4d2f-499f-aa00-82c2bb460837 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received unexpected event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd for instance with vm_state active and task_state shelving_image_uploading.
Jul 25 15:43:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-33759262-a4c2-42ac-a9e0-fa1f4f463524 req-04afb3d9-05fe-4d40-bfcf-2d403fbde677 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received event network-vif-plugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-33759262-a4c2-42ac-a9e0-fa1f4f463524 req-04afb3d9-05fe-4d40-bfcf-2d403fbde677 service nova] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-33759262-a4c2-42ac-a9e0-fa1f4f463524 req-04afb3d9-05fe-4d40-bfcf-2d403fbde677 service nova] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-33759262-a4c2-42ac-a9e0-fa1f4f463524 req-04afb3d9-05fe-4d40-bfcf-2d403fbde677 service nova] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-33759262-a4c2-42ac-a9e0-fa1f4f463524 req-04afb3d9-05fe-4d40-bfcf-2d403fbde677 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] No waiting events found dispatching network-vif-plugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:47 user nova-compute[70869]: WARNING nova.compute.manager [req-33759262-a4c2-42ac-a9e0-fa1f4f463524 req-04afb3d9-05fe-4d40-bfcf-2d403fbde677 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received unexpected event network-vif-plugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 for instance with vm_state building and task_state spawning.
Jul 25 15:43:47 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:48 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Snapshot image upload complete
Jul 25 15:43:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:48 user nova-compute[70869]: INFO nova.compute.manager [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Shelve offloading
Jul 25 15:43:48 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance destroyed successfully.
Jul 25 15:43:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquired lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-026ddf66-3235-4d53-8358-1cd6a9e14fae req-dd56b687-e879-4de4-8daf-6138397db58a service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received event network-vif-plugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-026ddf66-3235-4d53-8358-1cd6a9e14fae req-dd56b687-e879-4de4-8daf-6138397db58a service nova] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-026ddf66-3235-4d53-8358-1cd6a9e14fae req-dd56b687-e879-4de4-8daf-6138397db58a service nova] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-026ddf66-3235-4d53-8358-1cd6a9e14fae req-dd56b687-e879-4de4-8daf-6138397db58a service nova] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-026ddf66-3235-4d53-8358-1cd6a9e14fae req-dd56b687-e879-4de4-8daf-6138397db58a service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] No waiting events found dispatching network-vif-plugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:43:49 user nova-compute[70869]: WARNING nova.compute.manager [req-026ddf66-3235-4d53-8358-1cd6a9e14fae req-dd56b687-e879-4de4-8daf-6138397db58a service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received unexpected event network-vif-plugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 for instance with vm_state building and task_state spawning.
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299829.4838967, a7211b55-7b3f-455b-b185-4e6432faf006 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:49 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] VM Resumed (Lifecycle Event)
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:43:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Instance spawned successfully.
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:49 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299829.4910572, a7211b55-7b3f-455b-b185-4e6432faf006 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:49 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] VM Started (Lifecycle Event)
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:43:49 user nova-compute[70869]: INFO nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Took 8.31 seconds to spawn the instance on the hypervisor.
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:49 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:43:49 user nova-compute[70869]: INFO nova.compute.manager [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Took 9.86 seconds to build instance.
Jul 25 15:43:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-535ca4a8-611a-4c44-8c4d-43e68c5b5b2e tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.033s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating instance_info_cache with network_info: [{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Releasing lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:50 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance destroyed successfully.
Jul 25 15:43:50 user nova-compute[70869]: DEBUG nova.objects.instance [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'resources' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130419921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130419921',id=27,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBibbEANFpipugLVFSsyYgF7Xx6RRXls3oAwTaoxYPberG6kOOsbNUG8bY+SxGCe3UQ/4Me+ZJgD39OBGA19dXjFi/9teyY6MK62PbcwCIEvg5E2zAdMNXFkGMs5GUse8Q==',key_name='tempest-keypair-529975062',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-qvjhymog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member',shelved_at='2023-07-25T15:43:48.880010',shelved_host='user',shelved_image_id='d272a8ba-c4f1-49f7-ad87-aaef2e51dc82'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=bba84347-9d28-4789-8d45-3e39770c8f4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:43:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:43:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:43:50 user nova-compute[70869]: DEBUG os_vif [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:43:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc8120e3-6f, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:43:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:43:50 user nova-compute[70869]: INFO os_vif [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f')
Jul 25 15:43:50 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Deleting instance files /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f_del
Jul 25 15:43:50 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Deletion of /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f_del complete
Jul 25 15:43:50 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Deleted allocations for instance bba84347-9d28-4789-8d45-3e39770c8f4f
Jul 25 15:43:50 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299815.9909875, bb780430-2cb6-4443-98ed-a224ec35bf57 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:50 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] VM Stopped (Lifecycle Event)
Jul 25 15:43:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'numa_topology' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2e8833f9-d1ab-4c6f-a2c2-21d0af4d7e44 None None] [instance: bb780430-2cb6-4443-98ed-a224ec35bf57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-e6ad6f68-7b76-4fe7-84fc-845083f0a4d1 req-4580cf72-fcc8-47e2-994d-fd5aaf9c8f4b service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-changed-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-e6ad6f68-7b76-4fe7-84fc-845083f0a4d1 req-4580cf72-fcc8-47e2-994d-fd5aaf9c8f4b service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Refreshing instance network info cache due to event network-changed-dc8120e3-6fb4-438a-94a3-7cbb36406ebd. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e6ad6f68-7b76-4fe7-84fc-845083f0a4d1 req-4580cf72-fcc8-47e2-994d-fd5aaf9c8f4b service nova] Acquiring lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e6ad6f68-7b76-4fe7-84fc-845083f0a4d1 req-4580cf72-fcc8-47e2-994d-fd5aaf9c8f4b service nova] Acquired lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG nova.network.neutron [req-e6ad6f68-7b76-4fe7-84fc-845083f0a4d1 req-4580cf72-fcc8-47e2-994d-fd5aaf9c8f4b service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Refreshing network info cache for port dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:43:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-07adb777-defc-4601-9f86-4a366bb78ac0 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.982s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:43:52 user nova-compute[70869]: DEBUG nova.network.neutron [req-e6ad6f68-7b76-4fe7-84fc-845083f0a4d1 req-4580cf72-fcc8-47e2-994d-fd5aaf9c8f4b service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updated VIF entry in instance network info cache for port dc8120e3-6fb4-438a-94a3-7cbb36406ebd. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:43:52 user nova-compute[70869]: DEBUG nova.network.neutron [req-e6ad6f68-7b76-4fe7-84fc-845083f0a4d1 req-4580cf72-fcc8-47e2-994d-fd5aaf9c8f4b service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating instance_info_cache with network_info: [{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:43:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e6ad6f68-7b76-4fe7-84fc-845083f0a4d1 req-4580cf72-fcc8-47e2-994d-fd5aaf9c8f4b service nova] Releasing lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:43:53 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299818.6696386, 4d9706b8-2a69-4272-89d3-f8a985e0ad2c => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:53 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] VM Stopped (Lifecycle Event)
Jul 25 15:43:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-35c95662-47a5-4cdf-a740-5ca862c8f893 None None] [instance: 4d9706b8-2a69-4272-89d3-f8a985e0ad2c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:43:58 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299823.5559883, bba84347-9d28-4789-8d45-3e39770c8f4f => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:43:58 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] VM Stopped (Lifecycle Event)
Jul 25 15:43:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-845f3118-a033-4c8d-87f4-de12f27d41ad None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:43:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:44:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:44:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:44:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Going to confirm migration 2 {{(pid=70869) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4693}}
Jul 25 15:44:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:44:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquired lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:44:26 user nova-compute[70869]: DEBUG nova.network.neutron [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:44:26 user nova-compute[70869]: DEBUG nova.objects.instance [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'info_cache' on Instance uuid bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:44:27 user nova-compute[70869]: DEBUG nova.network.neutron [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating instance_info_cache with network_info: [{"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:44:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Releasing lock "refresh_cache-bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:44:27 user nova-compute[70869]: DEBUG nova.objects.instance [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'migration_context' on Instance uuid bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:44:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:44:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:44:27 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:44:28 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:44:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.628s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:44:28 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Deleted allocation for migration 7b143170-c785-4a8c-a5d5-85471ab4fb59
Jul 25 15:44:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-997e9122-d4bc-4400-b3e6-65fc42d34a93 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.802s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:44:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:34 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:44:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:44:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:44:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:44:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:44:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance_info_cache with network_info: [{"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:44:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-d384e3b6-8948-4db0-8d39-a340cb130c57" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:44:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:44:35 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:44:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:36 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:44:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:44:38 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:44:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:44:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:44:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:44:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:44:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:44:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:44:41 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:44:41 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7323MB free_disk=25.339855194091797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e69fa561-b002-49d7-8251-3de03ae44940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d384e3b6-8948-4db0-8d39-a340cb130c57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 58e838f4-a6e4-4292-a14a-f1e5894c615b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a7211b55-7b3f-455b-b185-4e6432faf006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:44:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:44:42 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:44:42 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:44:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:44:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:44:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:44:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:44:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:44:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:44:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:44:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:44:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:44:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:44:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:44:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:44:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:44:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:45:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:45:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:08 user nova-compute[70869]: INFO nova.compute.manager [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Rescuing
Jul 25 15:45:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:45:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquired lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:45:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Updating instance_info_cache with network_info: [{"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Releasing lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-782139be-1c76-4510-951a-594274dce90a req-99e52c34-26dc-45e1-bc60-a51d0cd35ad4 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-unplugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-782139be-1c76-4510-951a-594274dce90a req-99e52c34-26dc-45e1-bc60-a51d0cd35ad4 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-782139be-1c76-4510-951a-594274dce90a req-99e52c34-26dc-45e1-bc60-a51d0cd35ad4 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-782139be-1c76-4510-951a-594274dce90a req-99e52c34-26dc-45e1-bc60-a51d0cd35ad4 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-782139be-1c76-4510-951a-594274dce90a req-99e52c34-26dc-45e1-bc60-a51d0cd35ad4 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-unplugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:45:09 user nova-compute[70869]: WARNING nova.compute.manager [req-782139be-1c76-4510-951a-594274dce90a req-99e52c34-26dc-45e1-bc60-a51d0cd35ad4 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-unplugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state active and task_state rescuing.
Jul 25 15:45:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Instance destroyed successfully.
Jul 25 15:45:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Attempting a stable device rescue
Jul 25 15:45:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70869) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 15:45:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Instance directory exists: not creating {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 15:45:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Creating image(s)
Jul 25 15:45:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "/opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "/opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "/opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:10 user nova-compute[70869]: DEBUG nova.objects.instance [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'trusted_certs' on Instance uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "1fa0458252ba80e92e6625d03b78892cf4c74a32" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "1fa0458252ba80e92e6625d03b78892cf4c74a32" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32.part --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG nova.virt.images [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] e169cd3a-63d7-44c1-82ad-e4d81a99add0 was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32.part /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32.part /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32.converted" returned: 0 in 0.413s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-974dfba7-e901-4a94-82de-c0f16145a445 req-3c5549fc-94e1-4ef8-ae4b-b20b66ca0624 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-974dfba7-e901-4a94-82de-c0f16145a445 req-3c5549fc-94e1-4ef8-ae4b-b20b66ca0624 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-974dfba7-e901-4a94-82de-c0f16145a445 req-3c5549fc-94e1-4ef8-ae4b-b20b66ca0624 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-974dfba7-e901-4a94-82de-c0f16145a445 req-3c5549fc-94e1-4ef8-ae4b-b20b66ca0624 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-974dfba7-e901-4a94-82de-c0f16145a445 req-3c5549fc-94e1-4ef8-ae4b-b20b66ca0624 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:45:11 user nova-compute[70869]: WARNING nova.compute.manager [req-974dfba7-e901-4a94-82de-c0f16145a445 req-3c5549fc-94e1-4ef8-ae4b-b20b66ca0624 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state active and task_state rescuing.
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "1fa0458252ba80e92e6625d03b78892cf4c74a32" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.662s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "1fa0458252ba80e92e6625d03b78892cf4c74a32" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "1fa0458252ba80e92e6625d03b78892cf4c74a32" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32 --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32,backing_fmt=raw /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32,backing_fmt=raw /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue" returned: 0 in 0.049s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "1fa0458252ba80e92e6625d03b78892cf4c74a32" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'migration_context' on Instance uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Start _get_guest_xml network_info=[{"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "vif_mac": "fa:16:3e:6b:b4:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e169cd3a-63d7-44c1-82ad-e4d81a99add0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f4e4b267-301a-43af-8bff-e09c3f57ef0c', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbIeNnLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '58e838f4-a6e4-4292-a14a-f1e5894c615b', 'attached_at': '', 'detached_at': '', 'volume_id': '5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 'serial': '5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988'}, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'resources' on Instance uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'numa_topology' on Instance uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:12 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:45:12 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'vcpu_model' on Instance uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbIeNnLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:45:12 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:45:12 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:45:12 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d4295a-84e1-4658-acb2-a092b73e24f1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PbIeNnLG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 25 15:45:12 user nova-compute[70869]: node.name = iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:45:12 user nova-compute[70869]: node.tpgt = -1
Jul 25 15:45:12 user nova-compute[70869]: node.startup = automatic
Jul 25 15:45:12 user nova-compute[70869]: node.leading_login = No
Jul 25 15:45:12 user nova-compute[70869]: iface.iscsi_ifacename = default
Jul 25 15:45:12 user nova-compute[70869]: iface.net_ifacename = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.ipaddress = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.prefix_len = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.hwaddress = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.transport_name = tcp
Jul 25 15:45:12 user nova-compute[70869]: iface.initiatorname = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.state = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.vlan_id = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.vlan_priority = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.vlan_state = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.iface_num = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.mtu = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.port = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.bootproto = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.subnet_mask = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.gateway = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.dhcp_alt_client_id_state = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.dhcp_alt_client_id = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.dhcp_dns = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.dhcp_learn_iqn = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.dhcp_req_vendor_id_state = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.dhcp_vendor_id_state = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.dhcp_vendor_id = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.dhcp_slp_da = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.fragmentation = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.gratuitous_arp = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.incoming_forwarding = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.tos_state = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.tos = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.ttl = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.delayed_ack = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.tcp_nagle = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.tcp_wsf_state = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.tcp_wsf = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.tcp_timer_scale = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.tcp_timestamp = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.redirect = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.def_task_mgmt_timeout = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.header_digest = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.data_digest = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.immediate_data = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.initial_r2t = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.data_seq_inorder = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.data_pdu_inorder = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.erl = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.max_receive_data_len = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.first_burst_len = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.max_outstanding_r2t = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.max_burst_len = 0
Jul 25 15:45:12 user nova-compute[70869]: iface.chap_auth = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.bidi_chap = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.strict_login_compliance = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.discovery_auth = <empty>
Jul 25 15:45:12 user nova-compute[70869]: iface.discovery_logout = <empty>
Jul 25 15:45:12 user nova-compute[70869]: node.discovery_address = <empty>
Jul 25 15:45:12 user nova-compute[70869]: node.discovery_port = 0
Jul 25 15:45:12 user nova-compute[70869]: node.discovery_type = static
Jul 25 15:45:12 user nova-compute[70869]: node.session.initial_cmdsn = 0
Jul 25 15:45:12 user nova-compute[70869]: node.session.initial_login_retry_max = 8
Jul 25 15:45:12 user nova-compute[70869]: node.session.xmit_thread_priority = -20
Jul 25 15:45:12 user nova-compute[70869]: node.session.cmds_max = 128
Jul 25 15:45:12 user nova-compute[70869]: node.session.queue_depth = 32
Jul 25 15:45:12 user nova-compute[70869]: node.session.nr_sessions = 1
Jul 25 15:45:12 user nova-compute[70869]: node.session.auth.authmethod = CHAP
Jul 25 15:45:12 user nova-compute[70869]: node.session.auth.username = PbIeNnLG
Jul 25 15:45:12 user nova-compute[70869]: node.session.auth.password = ***
Jul 25 15:45:12 user nova-compute[70869]: node.session.auth.username_in = <empty>
Jul 25 15:45:12 user nova-compute[70869]: node.session.auth.password_in = <empty>
Jul 25 15:45:12 user nova-compute[70869]: node.session.auth.chap_algs = MD5
Jul 25 15:45:12 user nova-compute[70869]: node.session.timeo.replacement_timeout = 120
Jul 25 15:45:12 user nova-compute[70869]: node.session.err_timeo.abort_timeout = 15
Jul 25 15:45:12 user nova-compute[70869]: node.session.err_timeo.lu_reset_timeout = 30
Jul 25 15:45:12 user nova-compute[70869]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 25 15:45:12 user nova-compute[70869]: node.session.err_timeo.host_reset_timeout = 60
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.FastAbort = Yes
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.InitialR2T = No
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.ImmediateData = Yes
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.FirstBurstLength = 262144
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.MaxBurstLength = 16776192
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.DefaultTime2Retain = 0
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.DefaultTime2Wait = 2
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.MaxConnections = 1
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 25 15:45:12 user nova-compute[70869]: node.session.iscsi.ERL = 0
Jul 25 15:45:12 user nova-compute[70869]: node.session.scan = manual
Jul 25 15:45:12 user nova-compute[70869]: node.session.reopen_max = 0
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].address = 172.16.0.220
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].port = 3260
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].startup = manual
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].tcp.window_size = 524288
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].tcp.type_of_service = 0
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].timeo.logout_timeout = 15
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].timeo.login_timeout = 15
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].timeo.auth_timeout = 45
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].timeo.noop_out_interval = 5
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].timeo.noop_out_timeout = 5
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].iscsi.HeaderDigest = None
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].iscsi.DataDigest = None
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].iscsi.IFMarker = No
Jul 25 15:45:12 user nova-compute[70869]: node.conn[0].iscsi.OFMarker = No
Jul 25 15:45:12 user nova-compute[70869]: # END RECORD
Jul 25 15:45:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8c1cb-4b74-46b1-96ea-d3700fc1a80b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12a1075-cf06-4889-8eda-e81b127a8d03]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbIeNnLG {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbIeNnLG" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[41030951-d74c-414d-8f64-238f4e425f83]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PbIeNnLG'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d25bfc-a908-4b46-bea0-bf7ea6f9496b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[80302f4d-ec41-4073-ac45-6729e58e4ecb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:12 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:12 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:12 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:45:12 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:12 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:12 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:12 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:45:12 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] HCTL ('38', '0', '0', 0) found on session 38 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[581ae28b-2363-448a-b91c-3ba8cad396f9]: (4, ('0 0 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Searching for a device in session 38 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbIeNnLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '23934336436376633', 'path': '/dev/sdg'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934336436376633', 'path': '/dev/sdg'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-641923212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-641923212',id=28,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:43:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-6itgyw2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:43:43Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=58e838f4-a6e4-4292-a14a-f1e5894c615b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "vif_mac": "fa:16:3e:6b:b4:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "vif_mac": "fa:16:3e:6b:b4:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b4:8c,bridge_name='br-int',has_traffic_filtering=True,id=8624ca7f-ed89-4043-8c98-806cdf440681,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624ca7f-ed') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'pci_devices' on Instance uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:45:12 user nova-compute[70869]:   <uuid>58e838f4-a6e4-4292-a14a-f1e5894c615b</uuid>
Jul 25 15:45:12 user nova-compute[70869]:   <name>instance-0000001c</name>
Jul 25 15:45:12 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:45:12 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:45:12 user nova-compute[70869]:   <metadata>
Jul 25 15:45:12 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:45:12 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:45:12 user nova-compute[70869]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-641923212</nova:name>
Jul 25 15:45:12 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:45:12</nova:creationTime>
Jul 25 15:45:12 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:45:12 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:45:12 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:45:12 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:45:12 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:45:12 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:45:12 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:45:12 user nova-compute[70869]:       <nova:owner>
Jul 25 15:45:12 user nova-compute[70869]:         <nova:user uuid="02dfa618b8fc4b06b5e396b7da9e8443">tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member</nova:user>
Jul 25 15:45:12 user nova-compute[70869]:         <nova:project uuid="3735c3192f424a8abee7c1874609f005">tempest-ServerBootFromVolumeStableRescueTest-508290498</nova:project>
Jul 25 15:45:12 user nova-compute[70869]:       </nova:owner>
Jul 25 15:45:12 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:45:12 user nova-compute[70869]:       <nova:ports>
Jul 25 15:45:12 user nova-compute[70869]:         <nova:port uuid="8624ca7f-ed89-4043-8c98-806cdf440681">
Jul 25 15:45:12 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 15:45:12 user nova-compute[70869]:         </nova:port>
Jul 25 15:45:12 user nova-compute[70869]:       </nova:ports>
Jul 25 15:45:12 user nova-compute[70869]:     </nova:instance>
Jul 25 15:45:12 user nova-compute[70869]:   </metadata>
Jul 25 15:45:12 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:45:12 user nova-compute[70869]:     <system>
Jul 25 15:45:12 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:45:12 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:45:12 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:45:12 user nova-compute[70869]:       <entry name="serial">58e838f4-a6e4-4292-a14a-f1e5894c615b</entry>
Jul 25 15:45:12 user nova-compute[70869]:       <entry name="uuid">58e838f4-a6e4-4292-a14a-f1e5894c615b</entry>
Jul 25 15:45:12 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:45:12 user nova-compute[70869]:     </system>
Jul 25 15:45:12 user nova-compute[70869]:   </sysinfo>
Jul 25 15:45:12 user nova-compute[70869]:   <os>
Jul 25 15:45:12 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:45:12 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:45:12 user nova-compute[70869]:   </os>
Jul 25 15:45:12 user nova-compute[70869]:   <features>
Jul 25 15:45:12 user nova-compute[70869]:     <acpi/>
Jul 25 15:45:12 user nova-compute[70869]:     <apic/>
Jul 25 15:45:12 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:45:12 user nova-compute[70869]:   </features>
Jul 25 15:45:12 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:45:12 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:45:12 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:45:12 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:45:12 user nova-compute[70869]:   </clock>
Jul 25 15:45:12 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:45:12 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:45:12 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:45:12 user nova-compute[70869]:   </cpu>
Jul 25 15:45:12 user nova-compute[70869]:   <devices>
Jul 25 15:45:12 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:45:12 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:45:12 user nova-compute[70869]:       <source dev="/dev/sdg"/>
Jul 25 15:45:12 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:45:12 user nova-compute[70869]:       <serial>5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988</serial>
Jul 25 15:45:12 user nova-compute[70869]:     </disk>
Jul 25 15:45:12 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:45:12 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:45:12 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue"/>
Jul 25 15:45:12 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:45:12 user nova-compute[70869]:       <boot order="1"/>
Jul 25 15:45:12 user nova-compute[70869]:     </disk>
Jul 25 15:45:12 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:45:12 user nova-compute[70869]:       <mac address="fa:16:3e:6b:b4:8c"/>
Jul 25 15:45:12 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:45:12 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:45:12 user nova-compute[70869]:       <target dev="tap8624ca7f-ed"/>
Jul 25 15:45:12 user nova-compute[70869]:     </interface>
Jul 25 15:45:12 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:45:12 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/console.log" append="off"/>
Jul 25 15:45:12 user nova-compute[70869]:     </serial>
Jul 25 15:45:12 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:45:12 user nova-compute[70869]:     <video>
Jul 25 15:45:12 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:45:12 user nova-compute[70869]:     </video>
Jul 25 15:45:12 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:45:12 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:45:12 user nova-compute[70869]:     </rng>
Jul 25 15:45:12 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:45:12 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:45:12 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:45:12 user nova-compute[70869]:     </memballoon>
Jul 25 15:45:12 user nova-compute[70869]:   </devices>
Jul 25 15:45:12 user nova-compute[70869]: </domain>
Jul 25 15:45:12 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:45:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Instance destroyed successfully.
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:45:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] No VIF found with MAC fa:16:3e:6b:b4:8c, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:45:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-2b405c6c-f7c1-4b35-9c2c-80f9c161bb2a req-3bfbd5c2-8620-4853-8e1a-49d90e116be9 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b405c6c-f7c1-4b35-9c2c-80f9c161bb2a req-3bfbd5c2-8620-4853-8e1a-49d90e116be9 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b405c6c-f7c1-4b35-9c2c-80f9c161bb2a req-3bfbd5c2-8620-4853-8e1a-49d90e116be9 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b405c6c-f7c1-4b35-9c2c-80f9c161bb2a req-3bfbd5c2-8620-4853-8e1a-49d90e116be9 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-2b405c6c-f7c1-4b35-9c2c-80f9c161bb2a req-3bfbd5c2-8620-4853-8e1a-49d90e116be9 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:45:13 user nova-compute[70869]: WARNING nova.compute.manager [req-2b405c6c-f7c1-4b35-9c2c-80f9c161bb2a req-3bfbd5c2-8620-4853-8e1a-49d90e116be9 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state active and task_state rescuing.
Jul 25 15:45:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for 58e838f4-a6e4-4292-a14a-f1e5894c615b due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:45:15 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299915.926343, 58e838f4-a6e4-4292-a14a-f1e5894c615b => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:45:15 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] VM Resumed (Lifecycle Event)
Jul 25 15:45:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-43b13c95-a5b9-4122-b1c7-41c371ac02c0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:45:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:45:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:45:15 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 15:45:15 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299915.9300408, 58e838f4-a6e4-4292-a14a-f1e5894c615b => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:45:15 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] VM Started (Lifecycle Event)
Jul 25 15:45:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:45:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:45:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-2052367e-1ea3-42d1-8d8f-e5f3ea869d69 req-e957ea42-0724-43d9-937b-40972f7b5d27 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2052367e-1ea3-42d1-8d8f-e5f3ea869d69 req-e957ea42-0724-43d9-937b-40972f7b5d27 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2052367e-1ea3-42d1-8d8f-e5f3ea869d69 req-e957ea42-0724-43d9-937b-40972f7b5d27 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2052367e-1ea3-42d1-8d8f-e5f3ea869d69 req-e957ea42-0724-43d9-937b-40972f7b5d27 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-2052367e-1ea3-42d1-8d8f-e5f3ea869d69 req-e957ea42-0724-43d9-937b-40972f7b5d27 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:45:16 user nova-compute[70869]: WARNING nova.compute.manager [req-2052367e-1ea3-42d1-8d8f-e5f3ea869d69 req-e957ea42-0724-43d9-937b-40972f7b5d27 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state rescued and task_state None.
Jul 25 15:45:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-fa818ebe-5012-4ba1-9a05-8550b502f398 req-366ef6b1-7554-40ef-b3e5-607d40688314 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-fa818ebe-5012-4ba1-9a05-8550b502f398 req-366ef6b1-7554-40ef-b3e5-607d40688314 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing instance network info cache due to event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:45:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fa818ebe-5012-4ba1-9a05-8550b502f398 req-366ef6b1-7554-40ef-b3e5-607d40688314 service nova] Acquiring lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:45:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fa818ebe-5012-4ba1-9a05-8550b502f398 req-366ef6b1-7554-40ef-b3e5-607d40688314 service nova] Acquired lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:45:18 user nova-compute[70869]: DEBUG nova.network.neutron [req-fa818ebe-5012-4ba1-9a05-8550b502f398 req-366ef6b1-7554-40ef-b3e5-607d40688314 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:45:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:18 user nova-compute[70869]: DEBUG nova.network.neutron [req-fa818ebe-5012-4ba1-9a05-8550b502f398 req-366ef6b1-7554-40ef-b3e5-607d40688314 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updated VIF entry in instance network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.network.neutron [req-fa818ebe-5012-4ba1-9a05-8550b502f398 req-366ef6b1-7554-40ef-b3e5-607d40688314 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updating instance_info_cache with network_info: [{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fa818ebe-5012-4ba1-9a05-8550b502f398 req-366ef6b1-7554-40ef-b3e5-607d40688314 service nova] Releasing lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.compute.manager [req-ded5e5bd-19d4-44fe-9a56-bf440d36f1c7 req-be873e0d-4016-4c69-8a7c-dae31cdc80e4 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.compute.manager [req-ded5e5bd-19d4-44fe-9a56-bf440d36f1c7 req-be873e0d-4016-4c69-8a7c-dae31cdc80e4 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing instance network info cache due to event network-changed-110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ded5e5bd-19d4-44fe-9a56-bf440d36f1c7 req-be873e0d-4016-4c69-8a7c-dae31cdc80e4 service nova] Acquiring lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ded5e5bd-19d4-44fe-9a56-bf440d36f1c7 req-be873e0d-4016-4c69-8a7c-dae31cdc80e4 service nova] Acquired lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.network.neutron [req-ded5e5bd-19d4-44fe-9a56-bf440d36f1c7 req-be873e0d-4016-4c69-8a7c-dae31cdc80e4 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Refreshing network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:19 user nova-compute[70869]: INFO nova.compute.manager [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Detaching volume f0a05b0f-6e2b-4195-94d0-3414bbe8f31c
Jul 25 15:45:19 user nova-compute[70869]: INFO nova.virt.block_device [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Attempting to driver detach volume f0a05b0f-6e2b-4195-94d0-3414bbe8f31c from mountpoint /dev/vdb
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Attempting to detach device vdb from instance e69fa561-b002-49d7-8251-3de03ae44940 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:45:19 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:45:19 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:45:19 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:45:19 user nova-compute[70869]:   <serial>f0a05b0f-6e2b-4195-94d0-3414bbe8f31c</serial>
Jul 25 15:45:19 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 15:45:19 user nova-compute[70869]: </disk>
Jul 25 15:45:19 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:45:19 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully detached device vdb from instance e69fa561-b002-49d7-8251-3de03ae44940 from the persistent domain config.
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e69fa561-b002-49d7-8251-3de03ae44940 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:45:19 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:45:19 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:45:19 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:45:19 user nova-compute[70869]:   <serial>f0a05b0f-6e2b-4195-94d0-3414bbe8f31c</serial>
Jul 25 15:45:19 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 15:45:19 user nova-compute[70869]: </disk>
Jul 25 15:45:19 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.network.neutron [req-ded5e5bd-19d4-44fe-9a56-bf440d36f1c7 req-be873e0d-4016-4c69-8a7c-dae31cdc80e4 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updated VIF entry in instance network info cache for port 110266bd-c366-4bb6-981f-608cfc13ab13. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG nova.network.neutron [req-ded5e5bd-19d4-44fe-9a56-bf440d36f1c7 req-be873e0d-4016-4c69-8a7c-dae31cdc80e4 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updating instance_info_cache with network_info: [{"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:45:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ded5e5bd-19d4-44fe-9a56-bf440d36f1c7 req-be873e0d-4016-4c69-8a7c-dae31cdc80e4 service nova] Releasing lock "refresh_cache-e69fa561-b002-49d7-8251-3de03ae44940" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299920.0693965, e69fa561-b002-49d7-8251-3de03ae44940 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:45:20 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully detached device vdb from instance e69fa561-b002-49d7-8251-3de03ae44940 from the live domain config.
Jul 25 15:45:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtcHCblY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:45:20 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[85288be1-c6d4-45dd-b17a-577fc105c549]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:45:20 user nova-compute[70869]: No targets found.
Jul 25 15:45:20 user nova-compute[70869]: iSNS:
Jul 25 15:45:20 user nova-compute[70869]: No targets found.
Jul 25 15:45:20 user nova-compute[70869]: STATIC:
Jul 25 15:45:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:45:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:45:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c
Jul 25 15:45:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:45:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:45:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:20 user nova-compute[70869]: FIRMWARE:
Jul 25 15:45:20 user nova-compute[70869]: No targets found.
Jul 25 15:45:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:45:20 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:45:20 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee03867-574e-47cb-9bea-9e214560843e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c1279-c81e-478b-8d01-a3428ce57a13]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:20 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:20 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:20 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:45:20 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:20 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:20 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:20 user nova-compute[70869]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c (non-flash)
Jul 25 15:45:20 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c21b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca3035-7cce-438b-a8eb-aa2b2a3951b3]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec17e2-ad87-4736-aae9-7f147a156bac]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e6a0f4-03bc-4058-ae55-5dd7f1e97de4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1fcd84-95b2-4255-8edd-8293bf11ce4a]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24c4da-54dc-4727-8037-33aa2614a317]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c04b64b-7bbc-454e-b628-d10148b183a2]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260]
Jul 25 15:45:20 user nova-compute[70869]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c, portal: 172.16.0.220,3260] successful.
Jul 25 15:45:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0a05b0f-6e2b-4195-94d0-3414bbe8f31c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fedec3-c9a7-4fc6-b080-2ae2fa68ac81]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] <== disconnect_volume: return (331ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:45:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:45:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:21 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'flavor' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2c15ee04-1e3a-4e9b-92d6-5c5a35d6ff90 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.789s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:25 user nova-compute[70869]: INFO nova.compute.manager [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Terminating instance
Jul 25 15:45:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:45:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-d1485cb0-3ffc-4ac7-929a-896a727a1500 req-784a285f-1b8a-414e-8af8-427281a30e54 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-unplugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d1485cb0-3ffc-4ac7-929a-896a727a1500 req-784a285f-1b8a-414e-8af8-427281a30e54 service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d1485cb0-3ffc-4ac7-929a-896a727a1500 req-784a285f-1b8a-414e-8af8-427281a30e54 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d1485cb0-3ffc-4ac7-929a-896a727a1500 req-784a285f-1b8a-414e-8af8-427281a30e54 service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-d1485cb0-3ffc-4ac7-929a-896a727a1500 req-784a285f-1b8a-414e-8af8-427281a30e54 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-unplugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-d1485cb0-3ffc-4ac7-929a-896a727a1500 req-784a285f-1b8a-414e-8af8-427281a30e54 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-unplugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:26 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Instance destroyed successfully.
Jul 25 15:45:26 user nova-compute[70869]: DEBUG nova.objects.instance [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'resources' on Instance uuid 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1782526812',display_name='tempest-AttachVolumeTestJSON-server-1782526812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1782526812',id=17,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgx4fq1cT4MygBGosJgP3XPSWGKF3gnduqEAFmLa+F0YVFSQUPKLO96fGYOHT8HxxGd6r8xcuaJXn2eA+U3LK/s80eGJrh+hSaGuqjT1BrCFhcZworBSoltLMzly4CBDw==',key_name='tempest-keypair-660713528',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-3lkej28c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=00d20ec6-9f55-42f9-b4ed-6c02c9ac390f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "address": "fa:16:3e:de:f6:f9", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd545db2f-02", "ovs_interfaceid": "d545db2f-0230-400f-9bcd-e3db63ade6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG os_vif [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd545db2f-02, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:45:26 user nova-compute[70869]: INFO os_vif [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f6:f9,bridge_name='br-int',has_traffic_filtering=True,id=d545db2f-0230-400f-9bcd-e3db63ade6b6,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd545db2f-02')
Jul 25 15:45:26 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Deleting instance files /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f_del
Jul 25 15:45:26 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Deletion of /opt/stack/data/nova/instances/00d20ec6-9f55-42f9-b4ed-6c02c9ac390f_del complete
Jul 25 15:45:26 user nova-compute[70869]: INFO nova.compute.manager [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Took 0.74 seconds to destroy the instance on the hypervisor.
Jul 25 15:45:26 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:45:26 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:45:27 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:45:27 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Took 1.17 seconds to deallocate network for instance.
Jul 25 15:45:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-12fa55de-eb02-4c9f-bfb1-afe26f56bb9d req-3ba2f85e-6575-468e-8e3e-f04565222e57 service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-deleted-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:28 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:45:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-5018ff47-236c-4d59-8553-9469bb3c73c8 req-434b4169-7341-49cd-b3d1-891816626d4b service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5018ff47-236c-4d59-8553-9469bb3c73c8 req-434b4169-7341-49cd-b3d1-891816626d4b service nova] Acquiring lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5018ff47-236c-4d59-8553-9469bb3c73c8 req-434b4169-7341-49cd-b3d1-891816626d4b service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5018ff47-236c-4d59-8553-9469bb3c73c8 req-434b4169-7341-49cd-b3d1-891816626d4b service nova] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-5018ff47-236c-4d59-8553-9469bb3c73c8 req-434b4169-7341-49cd-b3d1-891816626d4b service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] No waiting events found dispatching network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:45:28 user nova-compute[70869]: WARNING nova.compute.manager [req-5018ff47-236c-4d59-8553-9469bb3c73c8 req-434b4169-7341-49cd-b3d1-891816626d4b service nova] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Received unexpected event network-vif-plugged-d545db2f-0230-400f-9bcd-e3db63ade6b6 for instance with vm_state deleted and task_state None.
Jul 25 15:45:28 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:45:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:28 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Deleted allocations for instance 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f
Jul 25 15:45:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-29003861-ed5d-44a0-b631-2cf3d10977c4 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "00d20ec6-9f55-42f9-b4ed-6c02c9ac390f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.729s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:31 user nova-compute[70869]: DEBUG nova.compute.manager [req-2dc11531-694c-4712-bcf3-0f77fbc4e6cd req-a79f1d01-ceb4-4e30-8b5a-0173ce7231ec service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received event network-changed-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:31 user nova-compute[70869]: DEBUG nova.compute.manager [req-2dc11531-694c-4712-bcf3-0f77fbc4e6cd req-a79f1d01-ceb4-4e30-8b5a-0173ce7231ec service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Refreshing instance network info cache due to event network-changed-839092bd-bc94-4891-b50c-a9cb6ae791f4. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:45:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2dc11531-694c-4712-bcf3-0f77fbc4e6cd req-a79f1d01-ceb4-4e30-8b5a-0173ce7231ec service nova] Acquiring lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:45:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2dc11531-694c-4712-bcf3-0f77fbc4e6cd req-a79f1d01-ceb4-4e30-8b5a-0173ce7231ec service nova] Acquired lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:45:31 user nova-compute[70869]: DEBUG nova.network.neutron [req-2dc11531-694c-4712-bcf3-0f77fbc4e6cd req-a79f1d01-ceb4-4e30-8b5a-0173ce7231ec service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Refreshing network info cache for port 839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:45:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-2dc11531-694c-4712-bcf3-0f77fbc4e6cd req-a79f1d01-ceb4-4e30-8b5a-0173ce7231ec service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updated VIF entry in instance network info cache for port 839092bd-bc94-4891-b50c-a9cb6ae791f4. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:45:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-2dc11531-694c-4712-bcf3-0f77fbc4e6cd req-a79f1d01-ceb4-4e30-8b5a-0173ce7231ec service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating instance_info_cache with network_info: [{"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:45:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2dc11531-694c-4712-bcf3-0f77fbc4e6cd req-a79f1d01-ceb4-4e30-8b5a-0173ce7231ec service nova] Releasing lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:45:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:34 user nova-compute[70869]: INFO nova.compute.manager [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Unshelving
Jul 25 15:45:34 user nova-compute[70869]: INFO nova.virt.block_device [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Booting with volume aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 at /dev/vdc
Jul 25 15:45:34 user nova-compute[70869]: DEBUG os_brick.utils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed37b6d-df52-4d4c-a04d-940b71b200be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b39df2f-efe7-4e4f-a1e6-357e0924c707]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[49467153-271a-402d-8020-59dc5fefb3e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa7a2b8-9234-47be-9ca4-b170ec86a5f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:45:35 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9542591b-e22b-4e1f-ba61-fa02d32392d9]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.utils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating existing volume attachment record: df346ffc-71d3-43df-be92-4a0a060136e5 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:35 user nova-compute[70869]: INFO nova.compute.manager [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attaching volume 48860d34-166d-4065-8e7a-8ab47bd42024 to /dev/vdb
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.utils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[db90e15c-9402-442d-8a54-54eef58cfbfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0c4518-5e9c-4d79-a066-9015c02064b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6416300a-1b5f-4417-901e-ac077f151edc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a6546-0e4e-4955-b0e4-f1dfb73acdcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:45:35 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:45:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf20f5-7566-4f55-8d22-37156936965f]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG os_brick.utils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:45:35 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating existing volume attachment record: 8f25dcba-d678-4797-9d76-aab8fd832fbb {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:45:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:36 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:38 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:38 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:45:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299926.2285945, 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:45:41 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] VM Stopped (Lifecycle Event)
Jul 25 15:45:41 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:45:41 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7692MB free_disk=25.262115478515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8a7c6b18-b3eb-4efc-a345-482f558bc319 None None] [instance: 00d20ec6-9f55-42f9-b4ed-6c02c9ac390f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e69fa561-b002-49d7-8251-3de03ae44940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d384e3b6-8948-4db0-8d39-a340cb130c57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 58e838f4-a6e4-4292-a14a-f1e5894c615b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a7211b55-7b3f-455b-b185-4e6432faf006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bba84347-9d28-4789-8d45-3e39770c8f4f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1724}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:45:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.223s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'pci_requests' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'numa_topology' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:45:42 user nova-compute[70869]: INFO nova.compute.claims [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Claim successful on node user
Jul 25 15:45:42 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:42 user nova-compute[70869]: INFO nova.network.neutron [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating port dc8120e3-6fb4-438a-94a3-7cbb36406ebd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crZuzSMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:45:42 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:45:42 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:45:42 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0172ad79-08e5-4445-ba8f-76176cbc37d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:45:42 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2866a1d-1061-47bf-a4dc-8bb15017ee4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024] added
Jul 25 15:45:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[669f5464-7b80-449c-aeb1-4924f5bff15d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[26686a55-29aa-442a-8ebb-226d609c94a1]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crZuzSMJ {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crZuzSMJ" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a5fdcd-2fb4-4141-a4d5-833ef0920901]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crZuzSMJ'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7765f95d-8bfb-427f-aaf2-3a4ad731383c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[851676fb-fd37-4f92-a445-19c1161a7d76]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:42 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:42 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:42 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:42 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:42 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:42 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:45:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a90c6d-4b93-49c7-9f09-3502bff8608c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024, portal: 172.16.0.220,3260]
Jul 25 15:45:43 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024, portal: 172.16.0.220,3260] successful.
Jul 25 15:45:43 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e97059f-a248-4320-92a0-daf8362a0c21]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[86adbf5b-124e-470e-850e-dc5c70fb9b0c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:43 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:43 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:43 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:43 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:45:43 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:43 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:43 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:43 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:43 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:45:43 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f9709-303f-4923-8964-815a978d1d84]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crZuzSMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquired lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-c7a410b9-05d0-40a0-8201-c0834fef9295 req-895ad038-986e-463a-bce3-fc6f19b3d486 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-changed-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-c7a410b9-05d0-40a0-8201-c0834fef9295 req-895ad038-986e-463a-bce3-fc6f19b3d486 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Refreshing instance network info cache due to event network-changed-dc8120e3-6fb4-438a-94a3-7cbb36406ebd. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c7a410b9-05d0-40a0-8201-c0834fef9295 req-895ad038-986e-463a-bce3-fc6f19b3d486 service nova] Acquiring lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating instance_info_cache with network_info: [{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Releasing lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:45:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Creating image(s)
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'trusted_certs' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c7a410b9-05d0-40a0-8201-c0834fef9295 req-895ad038-986e-463a-bce3-fc6f19b3d486 service nova] Acquired lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-c7a410b9-05d0-40a0-8201-c0834fef9295 req-895ad038-986e-463a-bce3-fc6f19b3d486 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Refreshing network info cache for port dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.823s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== connect_volume: return (1826ms) {'type': 'block', 'scsi_wwn': '23133393165303534', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133393165303534', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG nova.objects.instance [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:45:44 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:45:44 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:45:44 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:45:44 user nova-compute[70869]:   <serial>48860d34-166d-4065-8e7a-8ab47bd42024</serial>
Jul 25 15:45:44 user nova-compute[70869]: </disk>
Jul 25 15:45:44 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c.part --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG nova.virt.images [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] d272a8ba-c4f1-49f7-ad87-aaef2e51dc82 was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:45:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c.part /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-c7a410b9-05d0-40a0-8201-c0834fef9295 req-895ad038-986e-463a-bce3-fc6f19b3d486 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updated VIF entry in instance network info cache for port dc8120e3-6fb4-438a-94a3-7cbb36406ebd. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG nova.network.neutron [req-c7a410b9-05d0-40a0-8201-c0834fef9295 req-895ad038-986e-463a-bce3-fc6f19b3d486 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating instance_info_cache with network_info: [{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c.part /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c.converted" returned: 0 in 0.330s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c7a410b9-05d0-40a0-8201-c0834fef9295 req-895ad038-986e-463a-bce3-fc6f19b3d486 service nova] Releasing lock "refresh_cache-bba84347-9d28-4789-8d45-3e39770c8f4f" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No VIF found with MAC fa:16:3e:10:17:8d, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.434s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eff428c4-aaac-47ac-9d44-de80544adacf tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.595s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c,backing_fmt=raw /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c,backing_fmt=raw /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk 1073741824" returned: 0 in 0.048s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c --force-share --output=json" returned: 0 in 0.128s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'migration_context' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:45 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Rebasing disk image.
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 -F raw /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 -F raw /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk" returned: 0 in 1.890s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Ensure instance console log exists: /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Start _get_guest_xml network_info=[{"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b1abd57ed2c56e79e99ed7b9a678cfe8',container_format='bare',created_at=2023-07-25T15:43:43Z,direct_url=<?>,disk_format='qcow2',id=d272a8ba-c4f1-49f7-ad87-aaef2e51dc82,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2130419921-shelved',owner='fbda092d639f48ae873b25823e3547fe',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-25T15:43:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'df346ffc-71d3-43df-be92-4a0a060136e5', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdzPjJrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'bba84347-9d28-4789-8d45-3e39770c8f4f', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4', 'serial': 'aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4'}, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:45:47 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:45:47 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b1abd57ed2c56e79e99ed7b9a678cfe8',container_format='bare',created_at=2023-07-25T15:43:43Z,direct_url=<?>,disk_format='qcow2',id=d272a8ba-c4f1-49f7-ad87-aaef2e51dc82,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2130419921-shelved',owner='fbda092d639f48ae873b25823e3547fe',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-25T15:43:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'vcpu_model' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdzPjJrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:45:47 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:45:47 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:45:47 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb60dd0-9695-4f68-a8a2-5a6fef68a53a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:45:47 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d997dd-5b6f-466d-88c5-ac93a7133920]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4] added
Jul 25 15:45:47 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d47028-2b02-4788-a286-8309e87e00b7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37a6f2a-b0e3-4b69-b20a-47802f02fcb4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdzPjJrX {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdzPjJrX" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6fc688-a784-4b9b-8ab3-44f4929afa06]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DdzPjJrX'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ecc3bb-0308-4ad2-9e42-cfadfe51a544]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be0c388-dd19-4e6e-bb45-cf7a6c5d839e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:47 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:47 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:47 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:47 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:45:47 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:47 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:47 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:47 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:47 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:45:47 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:45:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a27d738-8aba-4b31-90ef-597535875ec2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4, portal: 172.16.0.220,3260]
Jul 25 15:45:48 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4, portal: 172.16.0.220,3260] successful.
Jul 25 15:45:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d399ae-e275-416c-b68c-aa915c249ffc]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[781e3147-f4fa-499b-998e-e64e551f3181]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:45:48 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffea512c-5c11-4db5-9be4-42c4dbe06ba6]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdzPjJrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:45:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26464663066333362', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464663066333362', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130419921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130419921',id=27,image_ref='d272a8ba-c4f1-49f7-ad87-aaef2e51dc82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-529975062',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-qvjhymog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member',shelved_at='2023-07-25T15:43:48.880010',shelved_host='user',shelved_image_id='d272a8ba-c4f1-49f7-ad87-aaef2e51dc82'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=bba84347-9d28-4789-8d45-3e39770c8f4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.objects.instance [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'pci_devices' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:45:49 user nova-compute[70869]:   <uuid>bba84347-9d28-4789-8d45-3e39770c8f4f</uuid>
Jul 25 15:45:49 user nova-compute[70869]:   <name>instance-0000001b</name>
Jul 25 15:45:49 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:45:49 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:45:49 user nova-compute[70869]:   <metadata>
Jul 25 15:45:49 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:45:49 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:45:49 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2130419921</nova:name>
Jul 25 15:45:49 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:45:47</nova:creationTime>
Jul 25 15:45:49 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:45:49 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:45:49 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:45:49 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:45:49 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:45:49 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:45:49 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:45:49 user nova-compute[70869]:       <nova:owner>
Jul 25 15:45:49 user nova-compute[70869]:         <nova:user uuid="713c16113e88444fb17474020846c914">tempest-AttachVolumeShelveTestJSON-1783080081-project-member</nova:user>
Jul 25 15:45:49 user nova-compute[70869]:         <nova:project uuid="fbda092d639f48ae873b25823e3547fe">tempest-AttachVolumeShelveTestJSON-1783080081</nova:project>
Jul 25 15:45:49 user nova-compute[70869]:       </nova:owner>
Jul 25 15:45:49 user nova-compute[70869]:       <nova:root type="image" uuid="d272a8ba-c4f1-49f7-ad87-aaef2e51dc82"/>
Jul 25 15:45:49 user nova-compute[70869]:       <nova:ports>
Jul 25 15:45:49 user nova-compute[70869]:         <nova:port uuid="dc8120e3-6fb4-438a-94a3-7cbb36406ebd">
Jul 25 15:45:49 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 25 15:45:49 user nova-compute[70869]:         </nova:port>
Jul 25 15:45:49 user nova-compute[70869]:       </nova:ports>
Jul 25 15:45:49 user nova-compute[70869]:     </nova:instance>
Jul 25 15:45:49 user nova-compute[70869]:   </metadata>
Jul 25 15:45:49 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:45:49 user nova-compute[70869]:     <system>
Jul 25 15:45:49 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:45:49 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:45:49 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:45:49 user nova-compute[70869]:       <entry name="serial">bba84347-9d28-4789-8d45-3e39770c8f4f</entry>
Jul 25 15:45:49 user nova-compute[70869]:       <entry name="uuid">bba84347-9d28-4789-8d45-3e39770c8f4f</entry>
Jul 25 15:45:49 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:45:49 user nova-compute[70869]:     </system>
Jul 25 15:45:49 user nova-compute[70869]:   </sysinfo>
Jul 25 15:45:49 user nova-compute[70869]:   <os>
Jul 25 15:45:49 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:45:49 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:45:49 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:45:49 user nova-compute[70869]:   </os>
Jul 25 15:45:49 user nova-compute[70869]:   <features>
Jul 25 15:45:49 user nova-compute[70869]:     <acpi/>
Jul 25 15:45:49 user nova-compute[70869]:     <apic/>
Jul 25 15:45:49 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:45:49 user nova-compute[70869]:   </features>
Jul 25 15:45:49 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:45:49 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:45:49 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:45:49 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:45:49 user nova-compute[70869]:   </clock>
Jul 25 15:45:49 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:45:49 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:45:49 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:45:49 user nova-compute[70869]:   </cpu>
Jul 25 15:45:49 user nova-compute[70869]:   <devices>
Jul 25 15:45:49 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:45:49 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:45:49 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk"/>
Jul 25 15:45:49 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:45:49 user nova-compute[70869]:     </disk>
Jul 25 15:45:49 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:45:49 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:45:49 user nova-compute[70869]:       <source dev="/dev/sdd"/>
Jul 25 15:45:49 user nova-compute[70869]:       <target dev="vdc" bus="virtio"/>
Jul 25 15:45:49 user nova-compute[70869]:       <serial>aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4</serial>
Jul 25 15:45:49 user nova-compute[70869]:     </disk>
Jul 25 15:45:49 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:45:49 user nova-compute[70869]:       <mac address="fa:16:3e:37:40:c9"/>
Jul 25 15:45:49 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:45:49 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:45:49 user nova-compute[70869]:       <target dev="tapdc8120e3-6f"/>
Jul 25 15:45:49 user nova-compute[70869]:     </interface>
Jul 25 15:45:49 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:45:49 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/console.log" append="off"/>
Jul 25 15:45:49 user nova-compute[70869]:     </serial>
Jul 25 15:45:49 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:45:49 user nova-compute[70869]:     <video>
Jul 25 15:45:49 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:45:49 user nova-compute[70869]:     </video>
Jul 25 15:45:49 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:45:49 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:45:49 user nova-compute[70869]:     </rng>
Jul 25 15:45:49 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:45:49 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:45:49 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:45:49 user nova-compute[70869]:     </memballoon>
Jul 25 15:45:49 user nova-compute[70869]:   </devices>
Jul 25 15:45:49 user nova-compute[70869]: </domain>
Jul 25 15:45:49 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130419921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130419921',id=27,image_ref='d272a8ba-c4f1-49f7-ad87-aaef2e51dc82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-529975062',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-qvjhymog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member',shelved_at='2023-07-25T15:43:48.880010',shelved_host='user',shelved_image_id='d272a8ba-c4f1-49f7-ad87-aaef2e51dc82'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=bba84347-9d28-4789-8d45-3e39770c8f4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG os_vif [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc8120e3-6f, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc8120e3-6f, col_values=(('external_ids', {'iface-id': 'dc8120e3-6fb4-438a-94a3-7cbb36406ebd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:40:c9', 'vm-uuid': 'bba84347-9d28-4789-8d45-3e39770c8f4f'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:49 user nova-compute[70869]: INFO os_vif [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f')
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:45:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] No VIF found with MAC fa:16:3e:37:40:c9, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:45:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:50 user nova-compute[70869]: DEBUG nova.compute.manager [req-4df3e82c-7855-49c6-9345-a2138647ba0f req-10b650c8-c074-45a0-b768-ff44e07c1650 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4df3e82c-7855-49c6-9345-a2138647ba0f req-10b650c8-c074-45a0-b768-ff44e07c1650 service nova] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4df3e82c-7855-49c6-9345-a2138647ba0f req-10b650c8-c074-45a0-b768-ff44e07c1650 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4df3e82c-7855-49c6-9345-a2138647ba0f req-10b650c8-c074-45a0-b768-ff44e07c1650 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:50 user nova-compute[70869]: DEBUG nova.compute.manager [req-4df3e82c-7855-49c6-9345-a2138647ba0f req-10b650c8-c074-45a0-b768-ff44e07c1650 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] No waiting events found dispatching network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:45:50 user nova-compute[70869]: WARNING nova.compute.manager [req-4df3e82c-7855-49c6-9345-a2138647ba0f req-10b650c8-c074-45a0-b768-ff44e07c1650 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received unexpected event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 15:45:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299952.6737316, bba84347-9d28-4789-8d45-3e39770c8f4f => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:45:52 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] VM Resumed (Lifecycle Event)
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:45:52 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance spawned successfully.
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:45:52 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299952.6828897, bba84347-9d28-4789-8d45-3e39770c8f4f => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:45:52 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] VM Started (Lifecycle Event)
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:45:52 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-70d217c4-b921-4195-af8d-176324f05ce5 req-60016d84-fd94-4991-a7c0-485274924557 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-70d217c4-b921-4195-af8d-176324f05ce5 req-60016d84-fd94-4991-a7c0-485274924557 service nova] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-70d217c4-b921-4195-af8d-176324f05ce5 req-60016d84-fd94-4991-a7c0-485274924557 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-70d217c4-b921-4195-af8d-176324f05ce5 req-60016d84-fd94-4991-a7c0-485274924557 service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-70d217c4-b921-4195-af8d-176324f05ce5 req-60016d84-fd94-4991-a7c0-485274924557 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] No waiting events found dispatching network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:45:52 user nova-compute[70869]: WARNING nova.compute.manager [req-70d217c4-b921-4195-af8d-176324f05ce5 req-60016d84-fd94-4991-a7c0-485274924557 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received unexpected event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 15:45:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:45:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-dc882b1b-3e9b-41f8-8f64-26c5119c0144 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.264s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:57 user nova-compute[70869]: INFO nova.compute.manager [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Terminating instance
Jul 25 15:45:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-8fa5b9f3-c1fa-4bdb-8a41-d2f6d9f29645 req-42fe0e5e-b837-4d04-ac45-943e02e6ed68 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-unplugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8fa5b9f3-c1fa-4bdb-8a41-d2f6d9f29645 req-42fe0e5e-b837-4d04-ac45-943e02e6ed68 service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8fa5b9f3-c1fa-4bdb-8a41-d2f6d9f29645 req-42fe0e5e-b837-4d04-ac45-943e02e6ed68 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8fa5b9f3-c1fa-4bdb-8a41-d2f6d9f29645 req-42fe0e5e-b837-4d04-ac45-943e02e6ed68 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-8fa5b9f3-c1fa-4bdb-8a41-d2f6d9f29645 req-42fe0e5e-b837-4d04-ac45-943e02e6ed68 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-unplugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-8fa5b9f3-c1fa-4bdb-8a41-d2f6d9f29645 req-42fe0e5e-b837-4d04-ac45-943e02e6ed68 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-unplugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:45:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Instance destroyed successfully.
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lazy-loading 'resources' on Instance uuid d384e3b6-8948-4db0-8d39-a340cb130c57 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-244416485',display_name='tempest-ServerActionsTestOtherB-server-244416485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-244416485',id=19,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCXboWq8wEzceGCnyi332NqxevvINDJCRjntKF4hIJqpSF49+vs1jbRHF6AATQTYe8No7x4pmRlaWfwGgtbv6ak2EUh6sjCd7bivOrD55NzuNL4hDOGe4J6h+BwET+hSw==',key_name='tempest-keypair-273420356',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:43:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a893391d45fd4eafa016e42722702ac2',ramdisk_id='',reservation_id='r-mt2igj69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1757328199',owner_user_name='tempest-ServerActionsTestOtherB-1757328199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:43:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5363af86370d49bd8082de16ae83a936',uuid=d384e3b6-8948-4db0-8d39-a340cb130c57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converting VIF {"id": "eebac77a-9411-485f-b850-c2798d0b4b24", "address": "fa:16:3e:e3:a3:59", "network": {"id": "a6fb8e3e-a681-4934-bdb1-02d5ead88b59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1360392007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a893391d45fd4eafa016e42722702ac2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeebac77a-94", "ovs_interfaceid": "eebac77a-9411-485f-b850-c2798d0b4b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_vif [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeebac77a-94, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:45:58 user nova-compute[70869]: INFO os_vif [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=eebac77a-9411-485f-b850-c2798d0b4b24,network=Network(a6fb8e3e-a681-4934-bdb1-02d5ead88b59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeebac77a-94')
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYkqcBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:45:58 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f280e5-c530-4404-b6b5-6c65cb643b37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:45:58 user nova-compute[70869]: No targets found.
Jul 25 15:45:58 user nova-compute[70869]: iSNS:
Jul 25 15:45:58 user nova-compute[70869]: No targets found.
Jul 25 15:45:58 user nova-compute[70869]: STATIC:
Jul 25 15:45:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:45:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6
Jul 25 15:45:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4
Jul 25 15:45:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024
Jul 25 15:45:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:45:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:58 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:45:58 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:45:58 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:45:58 user nova-compute[70869]: FIRMWARE:
Jul 25 15:45:58 user nova-compute[70869]: No targets found.
Jul 25 15:45:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:45:58 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:45:58 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea112f-9238-4dd0-9102-7a5946adaf45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[323fe7a7-77ac-43ac-b5a9-9ea5e2d24498]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:45:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c053250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6'): ({'sdf'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Removing single pathed devices sdf {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e585d0c-a626-4679-92b6-4c5ad70aefe3]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a441c618-ca14-4acc-9def-e367c635a7f0]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Flushing IO for device /dev/sdf {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1739d8-27f6-4877-88f4-d11d64414845]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[631776d3-84c5-4d71-8072-4cff69efe41c]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] SCSI volumes sdf have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9824ef12-edc9-48be-92e1-515782e9c2cf]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b864c1b8-d2ca-49cc-bb61-2a56474a9711]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260]
Jul 25 15:45:58 user nova-compute[70869]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6, portal: 172.16.0.220,3260] successful.
Jul 25 15:45:58 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6705f875-bf92-4305-8d7d-6d56c565bbf6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf8e350-859d-4c70-ae7a-afc7f177f74f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] <== disconnect_volume: return (326ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:45:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Deleting instance files /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57_del
Jul 25 15:45:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Deletion of /opt/stack/data/nova/instances/d384e3b6-8948-4db0-8d39-a340cb130c57_del complete
Jul 25 15:45:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:45:58 user nova-compute[70869]: INFO nova.compute.manager [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Took 1.24 seconds to destroy the instance on the hypervisor.
Jul 25 15:45:58 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:45:58 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:46:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-35f6efad-00e7-49e2-bbf1-b7b24b17c53f req-6c91146d-a7b5-4c03-a307-6be90b765838 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:46:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-35f6efad-00e7-49e2-bbf1-b7b24b17c53f req-6c91146d-a7b5-4c03-a307-6be90b765838 service nova] Acquiring lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-35f6efad-00e7-49e2-bbf1-b7b24b17c53f req-6c91146d-a7b5-4c03-a307-6be90b765838 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-35f6efad-00e7-49e2-bbf1-b7b24b17c53f req-6c91146d-a7b5-4c03-a307-6be90b765838 service nova] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-35f6efad-00e7-49e2-bbf1-b7b24b17c53f req-6c91146d-a7b5-4c03-a307-6be90b765838 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] No waiting events found dispatching network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:46:00 user nova-compute[70869]: WARNING nova.compute.manager [req-35f6efad-00e7-49e2-bbf1-b7b24b17c53f req-6c91146d-a7b5-4c03-a307-6be90b765838 service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received unexpected event network-vif-plugged-eebac77a-9411-485f-b850-c2798d0b4b24 for instance with vm_state active and task_state deleting.
Jul 25 15:46:00 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:46:00 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Took 1.17 seconds to deallocate network for instance.
Jul 25 15:46:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-e6610862-d528-4b24-b156-b12b30177044 req-75b05335-6ba3-4fd8-8f5b-d3dd304d2ddc service nova] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Received event network-vif-deleted-eebac77a-9411-485f-b850-c2798d0b4b24 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:46:00 user nova-compute[70869]: INFO nova.compute.manager [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Took 0.78 seconds to detach 1 volumes for instance.
Jul 25 15:46:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:01 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:46:01 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:46:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:01 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Deleted allocations for instance d384e3b6-8948-4db0-8d39-a340cb130c57
Jul 25 15:46:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5cbbdd99-2480-4f62-b9d7-b38cc3c46f2a tempest-ServerActionsTestOtherB-1757328199 tempest-ServerActionsTestOtherB-1757328199-project-member] Lock "d384e3b6-8948-4db0-8d39-a340cb130c57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.742s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:02 user nova-compute[70869]: INFO nova.compute.manager [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Detaching volume 48860d34-166d-4065-8e7a-8ab47bd42024
Jul 25 15:46:02 user nova-compute[70869]: INFO nova.virt.block_device [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attempting to driver detach volume 48860d34-166d-4065-8e7a-8ab47bd42024 from mountpoint /dev/vdb
Jul 25 15:46:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Attempting to detach device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:46:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:46:02 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:46:02 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:46:02 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:46:02 user nova-compute[70869]:   <serial>48860d34-166d-4065-8e7a-8ab47bd42024</serial>
Jul 25 15:46:02 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:46:02 user nova-compute[70869]: </disk>
Jul 25 15:46:02 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:46:02 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully detached device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the persistent domain config.
Jul 25 15:46:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:46:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:46:02 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:46:02 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:46:02 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:46:02 user nova-compute[70869]:   <serial>48860d34-166d-4065-8e7a-8ab47bd42024</serial>
Jul 25 15:46:02 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:46:02 user nova-compute[70869]: </disk>
Jul 25 15:46:02 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690299963.2550826, a7211b55-7b3f-455b-b185-4e6432faf006 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:46:03 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully detached device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the live domain config.
Jul 25 15:46:03 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crZuzSMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:46:03 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd153f3d-885d-491e-b8ee-067cd7a9d134]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:46:03 user nova-compute[70869]: No targets found.
Jul 25 15:46:03 user nova-compute[70869]: iSNS:
Jul 25 15:46:03 user nova-compute[70869]: No targets found.
Jul 25 15:46:03 user nova-compute[70869]: STATIC:
Jul 25 15:46:03 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:46:03 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:46:03 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:46:03 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4
Jul 25 15:46:03 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:46:03 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:46:03 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024
Jul 25 15:46:03 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:46:03 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:46:03 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:46:03 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:46:03 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:46:03 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:46:03 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:46:03 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:46:03 user nova-compute[70869]: FIRMWARE:
Jul 25 15:46:03 user nova-compute[70869]: No targets found.
Jul 25 15:46:03 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:46:03 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:46:03 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[93596ef6-09e2-47d8-b79f-db2b1da3445e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c6eda-242e-4075-81fc-76789f874e88]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:46:03 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:46:03 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:46:03 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:46:03 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:46:03 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:46:03 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:46:03 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:46:03 user nova-compute[70869]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 (non-flash)
Jul 25 15:46:03 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:46:03 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe41c411000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cb35b7-6d10-4e3d-9619-fd124d37625e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[25acf5ec-7a34-428b-82bb-04cdbc76703a]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f3f12-12e1-4231-bfc3-dafd4ed06b00]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47adddb-c7b8-410f-94a9-ec5c04b13a30]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5859402f-c30e-4037-a020-fc47397145a1]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aa55f5-2e06-4032-ad4a-a64cabd0b3e3]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024, portal: 172.16.0.220,3260]
Jul 25 15:46:03 user nova-compute[70869]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024, portal: 172.16.0.220,3260] successful.
Jul 25 15:46:03 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48860d34-166d-4065-8e7a-8ab47bd42024 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb70b1f-7d17-4a13-ab3b-8a2c4809b24c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== disconnect_volume: return (305ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:46:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:04 user nova-compute[70869]: DEBUG nova.objects.instance [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:46:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1e561e97-1f55-4c44-8c55-d8c4883026a4 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.814s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:13 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299958.4988558, d384e3b6-8948-4db0-8d39-a340cb130c57 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:46:13 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] VM Stopped (Lifecycle Event)
Jul 25 15:46:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-48952d45-b74f-423a-b2e0-a61c95d70c4c None None] [instance: d384e3b6-8948-4db0-8d39-a340cb130c57] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:46:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:15 user nova-compute[70869]: INFO nova.compute.manager [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Terminating instance
Jul 25 15:46:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-72dfb2d4-33fc-4cdc-8d31-a1d2d14f4d23 req-c8a51c1b-f9c6-416b-9515-78a019c3efa1 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-unplugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72dfb2d4-33fc-4cdc-8d31-a1d2d14f4d23 req-c8a51c1b-f9c6-416b-9515-78a019c3efa1 service nova] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72dfb2d4-33fc-4cdc-8d31-a1d2d14f4d23 req-c8a51c1b-f9c6-416b-9515-78a019c3efa1 service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-72dfb2d4-33fc-4cdc-8d31-a1d2d14f4d23 req-c8a51c1b-f9c6-416b-9515-78a019c3efa1 service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-72dfb2d4-33fc-4cdc-8d31-a1d2d14f4d23 req-c8a51c1b-f9c6-416b-9515-78a019c3efa1 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] No waiting events found dispatching network-vif-unplugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:46:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-72dfb2d4-33fc-4cdc-8d31-a1d2d14f4d23 req-c8a51c1b-f9c6-416b-9515-78a019c3efa1 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-unplugged-110266bd-c366-4bb6-981f-608cfc13ab13 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:46:16 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Instance destroyed successfully.
Jul 25 15:46:16 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'resources' on Instance uuid e69fa561-b002-49d7-8251-3de03ae44940 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1969392480',display_name='tempest-TestMinimumBasicScenario-server-1969392480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1969392480',id=26,image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQgML7ATcFoxWxXjJc8agfkcR/GfGqrezO6JWItXGR4qsG0lUjNUHSBon21VdVXFvHrM1OdFDo7u7bX5JOxfW5DD+4X3WzLxSXlFymCahyF2wWw3cygbBT4zMhy49Dx6w==',key_name='tempest-TestMinimumBasicScenario-2020211488',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c07ad06e29c4d2dbe409fa13979b81b',ramdisk_id='',reservation_id='r-evznqodo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed132aaf-7487-4fae-8bce-0c773d559b1a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1773990321',owner_user_name='tempest-TestMinimumBasicScenario-1773990321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:43:35Z,user_data=None,user_id='a905cee33a204704937a0224b3e6fab1',uuid=e69fa561-b002-49d7-8251-3de03ae44940,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converting VIF {"id": "110266bd-c366-4bb6-981f-608cfc13ab13", "address": "fa:16:3e:4a:f2:ce", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110266bd-c3", "ovs_interfaceid": "110266bd-c366-4bb6-981f-608cfc13ab13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG os_vif [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap110266bd-c3, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:16 user nova-compute[70869]: INFO os_vif [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f2:ce,bridge_name='br-int',has_traffic_filtering=True,id=110266bd-c366-4bb6-981f-608cfc13ab13,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110266bd-c3')
Jul 25 15:46:16 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Deleting instance files /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940_del
Jul 25 15:46:16 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Deletion of /opt/stack/data/nova/instances/e69fa561-b002-49d7-8251-3de03ae44940_del complete
Jul 25 15:46:16 user nova-compute[70869]: INFO nova.compute.manager [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 25 15:46:16 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:46:16 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: e69fa561-b002-49d7-8251-3de03ae44940] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:46:17 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:46:17 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Took 1.00 seconds to deallocate network for instance.
Jul 25 15:46:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:17 user nova-compute[70869]: INFO nova.compute.manager [None req-adf388b9-8675-46ee-aed0-edfc72fe6c15 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Get console output
Jul 25 15:46:17 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:46:17 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:46:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-108f0c0b-f07f-4f2d-bf0b-38e355f22173 req-71f62cb3-0b16-4f53-9a34-a2a67320aa11 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:46:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-108f0c0b-f07f-4f2d-bf0b-38e355f22173 req-71f62cb3-0b16-4f53-9a34-a2a67320aa11 service nova] Acquiring lock "e69fa561-b002-49d7-8251-3de03ae44940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-108f0c0b-f07f-4f2d-bf0b-38e355f22173 req-71f62cb3-0b16-4f53-9a34-a2a67320aa11 service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-108f0c0b-f07f-4f2d-bf0b-38e355f22173 req-71f62cb3-0b16-4f53-9a34-a2a67320aa11 service nova] Lock "e69fa561-b002-49d7-8251-3de03ae44940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-108f0c0b-f07f-4f2d-bf0b-38e355f22173 req-71f62cb3-0b16-4f53-9a34-a2a67320aa11 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] No waiting events found dispatching network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:46:17 user nova-compute[70869]: WARNING nova.compute.manager [req-108f0c0b-f07f-4f2d-bf0b-38e355f22173 req-71f62cb3-0b16-4f53-9a34-a2a67320aa11 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received unexpected event network-vif-plugged-110266bd-c366-4bb6-981f-608cfc13ab13 for instance with vm_state deleted and task_state None.
Jul 25 15:46:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-108f0c0b-f07f-4f2d-bf0b-38e355f22173 req-71f62cb3-0b16-4f53-9a34-a2a67320aa11 service nova] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Received event network-vif-deleted-110266bd-c366-4bb6-981f-608cfc13ab13 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:46:17 user nova-compute[70869]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 25 15:46:17 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Deleted allocations for instance e69fa561-b002-49d7-8251-3de03ae44940
Jul 25 15:46:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e4b72493-cdc7-4f14-ae50-1cec8086b3be tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "e69fa561-b002-49d7-8251-3de03ae44940" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.469s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:46:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:20 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:46:20 user nova-compute[70869]: INFO nova.compute.claims [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Claim successful on node user
Jul 25 15:46:20 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:46:20 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:46:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:20 user nova-compute[70869]: DEBUG nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:46:21 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.policy [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d528e01a08f40d4b598ab8222c2edf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f5d520a39742c69302f96795d0ea61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:46:21 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Creating image(s)
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "/opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "/opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk 1073741824" returned: 0 in 0.053s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Successfully created port: 4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Cannot resize image /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.objects.instance [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'migration_context' on Instance uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Ensure instance console log exists: /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Successfully updated port: 4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "refresh_cache-bfa66e15-724c-4192-b860-5a221b9c0ba3" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquired lock "refresh_cache-bfa66e15-724c-4192-b860-5a221b9c0ba3" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-7b62c6bf-ec91-47b0-91f4-f57fab6825d4 req-39ca0802-4c34-45c0-bc1d-a3ec2a88cd19 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received event network-changed-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-7b62c6bf-ec91-47b0-91f4-f57fab6825d4 req-39ca0802-4c34-45c0-bc1d-a3ec2a88cd19 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Refreshing instance network info cache due to event network-changed-4d5dfc99-2612-4f21-96c1-dd195692db33. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7b62c6bf-ec91-47b0-91f4-f57fab6825d4 req-39ca0802-4c34-45c0-bc1d-a3ec2a88cd19 service nova] Acquiring lock "refresh_cache-bfa66e15-724c-4192-b860-5a221b9c0ba3" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.network.neutron [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Updating instance_info_cache with network_info: [{"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Releasing lock "refresh_cache-bfa66e15-724c-4192-b860-5a221b9c0ba3" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Instance network_info: |[{"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7b62c6bf-ec91-47b0-91f4-f57fab6825d4 req-39ca0802-4c34-45c0-bc1d-a3ec2a88cd19 service nova] Acquired lock "refresh_cache-bfa66e15-724c-4192-b860-5a221b9c0ba3" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.network.neutron [req-7b62c6bf-ec91-47b0-91f4-f57fab6825d4 req-39ca0802-4c34-45c0-bc1d-a3ec2a88cd19 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Refreshing network info cache for port 4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Start _get_guest_xml network_info=[{"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:46:22 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:46:22 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-603986360',display_name='tempest-AttachVolumeTestJSON-server-603986360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-603986360',id=30,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO5oqqa0gFlqswHtc2eA/xRjuuMvUDSBXadrNXwp6YDCGf+ztaeALe5wOWNRDZF8cyblr/POnOOBGtg5/pmho5dUYPfMhnUHAGzSkHJldKFSsfaYBM65z2GaQ2BZm8Z9w==',key_name='tempest-keypair-2111458639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-9kxxasi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=bfa66e15-724c-4192-b860-5a221b9c0ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=4d5dfc99-2612-4f21-96c1-dd195692db33,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5dfc99-26') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.objects.instance [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'pci_devices' on Instance uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:46:22 user nova-compute[70869]:   <uuid>bfa66e15-724c-4192-b860-5a221b9c0ba3</uuid>
Jul 25 15:46:22 user nova-compute[70869]:   <name>instance-0000001e</name>
Jul 25 15:46:22 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:46:22 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:46:22 user nova-compute[70869]:   <metadata>
Jul 25 15:46:22 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:46:22 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:46:22 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeTestJSON-server-603986360</nova:name>
Jul 25 15:46:22 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:46:22</nova:creationTime>
Jul 25 15:46:22 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:46:22 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:46:22 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:46:22 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:46:22 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:46:22 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:46:22 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:46:22 user nova-compute[70869]:       <nova:owner>
Jul 25 15:46:22 user nova-compute[70869]:         <nova:user uuid="3d528e01a08f40d4b598ab8222c2edf5">tempest-AttachVolumeTestJSON-512738646-project-member</nova:user>
Jul 25 15:46:22 user nova-compute[70869]:         <nova:project uuid="d2f5d520a39742c69302f96795d0ea61">tempest-AttachVolumeTestJSON-512738646</nova:project>
Jul 25 15:46:22 user nova-compute[70869]:       </nova:owner>
Jul 25 15:46:22 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:46:22 user nova-compute[70869]:       <nova:ports>
Jul 25 15:46:22 user nova-compute[70869]:         <nova:port uuid="4d5dfc99-2612-4f21-96c1-dd195692db33">
Jul 25 15:46:22 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 15:46:22 user nova-compute[70869]:         </nova:port>
Jul 25 15:46:22 user nova-compute[70869]:       </nova:ports>
Jul 25 15:46:22 user nova-compute[70869]:     </nova:instance>
Jul 25 15:46:22 user nova-compute[70869]:   </metadata>
Jul 25 15:46:22 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:46:22 user nova-compute[70869]:     <system>
Jul 25 15:46:22 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:46:22 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:46:22 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:46:22 user nova-compute[70869]:       <entry name="serial">bfa66e15-724c-4192-b860-5a221b9c0ba3</entry>
Jul 25 15:46:22 user nova-compute[70869]:       <entry name="uuid">bfa66e15-724c-4192-b860-5a221b9c0ba3</entry>
Jul 25 15:46:22 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:46:22 user nova-compute[70869]:     </system>
Jul 25 15:46:22 user nova-compute[70869]:   </sysinfo>
Jul 25 15:46:22 user nova-compute[70869]:   <os>
Jul 25 15:46:22 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:46:22 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:46:22 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:46:22 user nova-compute[70869]:   </os>
Jul 25 15:46:22 user nova-compute[70869]:   <features>
Jul 25 15:46:22 user nova-compute[70869]:     <acpi/>
Jul 25 15:46:22 user nova-compute[70869]:     <apic/>
Jul 25 15:46:22 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:46:22 user nova-compute[70869]:   </features>
Jul 25 15:46:22 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:46:22 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:46:22 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:46:22 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:46:22 user nova-compute[70869]:   </clock>
Jul 25 15:46:22 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:46:22 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:46:22 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:46:22 user nova-compute[70869]:   </cpu>
Jul 25 15:46:22 user nova-compute[70869]:   <devices>
Jul 25 15:46:22 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:46:22 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:46:22 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk"/>
Jul 25 15:46:22 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:46:22 user nova-compute[70869]:     </disk>
Jul 25 15:46:22 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:46:22 user nova-compute[70869]:       <mac address="fa:16:3e:3f:1c:5b"/>
Jul 25 15:46:22 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:46:22 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:46:22 user nova-compute[70869]:       <target dev="tap4d5dfc99-26"/>
Jul 25 15:46:22 user nova-compute[70869]:     </interface>
Jul 25 15:46:22 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:46:22 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/console.log" append="off"/>
Jul 25 15:46:22 user nova-compute[70869]:     </serial>
Jul 25 15:46:22 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:46:22 user nova-compute[70869]:     <video>
Jul 25 15:46:22 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:46:22 user nova-compute[70869]:     </video>
Jul 25 15:46:22 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:46:22 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:46:22 user nova-compute[70869]:     </rng>
Jul 25 15:46:22 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:46:22 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:46:22 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:46:22 user nova-compute[70869]:     </memballoon>
Jul 25 15:46:22 user nova-compute[70869]:   </devices>
Jul 25 15:46:22 user nova-compute[70869]: </domain>
Jul 25 15:46:22 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-603986360',display_name='tempest-AttachVolumeTestJSON-server-603986360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-603986360',id=30,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO5oqqa0gFlqswHtc2eA/xRjuuMvUDSBXadrNXwp6YDCGf+ztaeALe5wOWNRDZF8cyblr/POnOOBGtg5/pmho5dUYPfMhnUHAGzSkHJldKFSsfaYBM65z2GaQ2BZm8Z9w==',key_name='tempest-keypair-2111458639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-9kxxasi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=bfa66e15-724c-4192-b860-5a221b9c0ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=4d5dfc99-2612-4f21-96c1-dd195692db33,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5dfc99-26') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG os_vif [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=4d5dfc99-2612-4f21-96c1-dd195692db33,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5dfc99-26') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d5dfc99-26, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d5dfc99-26, col_values=(('external_ids', {'iface-id': '4d5dfc99-2612-4f21-96c1-dd195692db33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:1c:5b', 'vm-uuid': 'bfa66e15-724c-4192-b860-5a221b9c0ba3'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:46:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:22 user nova-compute[70869]: INFO os_vif [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=4d5dfc99-2612-4f21-96c1-dd195692db33,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5dfc99-26')
Jul 25 15:46:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:46:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No VIF found with MAC fa:16:3e:3f:1c:5b, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:46:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-7b62c6bf-ec91-47b0-91f4-f57fab6825d4 req-39ca0802-4c34-45c0-bc1d-a3ec2a88cd19 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Updated VIF entry in instance network info cache for port 4d5dfc99-2612-4f21-96c1-dd195692db33. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:46:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-7b62c6bf-ec91-47b0-91f4-f57fab6825d4 req-39ca0802-4c34-45c0-bc1d-a3ec2a88cd19 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Updating instance_info_cache with network_info: [{"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:46:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7b62c6bf-ec91-47b0-91f4-f57fab6825d4 req-39ca0802-4c34-45c0-bc1d-a3ec2a88cd19 service nova] Releasing lock "refresh_cache-bfa66e15-724c-4192-b860-5a221b9c0ba3" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:46:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-2f4fcce6-9d88-4aa3-b5ee-3c13e550d7cf req-465b3008-003b-4950-a8d2-6b9f63fcb659 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received event network-vif-plugged-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2f4fcce6-9d88-4aa3-b5ee-3c13e550d7cf req-465b3008-003b-4950-a8d2-6b9f63fcb659 service nova] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2f4fcce6-9d88-4aa3-b5ee-3c13e550d7cf req-465b3008-003b-4950-a8d2-6b9f63fcb659 service nova] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2f4fcce6-9d88-4aa3-b5ee-3c13e550d7cf req-465b3008-003b-4950-a8d2-6b9f63fcb659 service nova] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-2f4fcce6-9d88-4aa3-b5ee-3c13e550d7cf req-465b3008-003b-4950-a8d2-6b9f63fcb659 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] No waiting events found dispatching network-vif-plugged-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:46:24 user nova-compute[70869]: WARNING nova.compute.manager [req-2f4fcce6-9d88-4aa3-b5ee-3c13e550d7cf req-465b3008-003b-4950-a8d2-6b9f63fcb659 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received unexpected event network-vif-plugged-4d5dfc99-2612-4f21-96c1-dd195692db33 for instance with vm_state building and task_state spawning.
Jul 25 15:46:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299986.3978727, bfa66e15-724c-4192-b860-5a221b9c0ba3 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:46:26 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] VM Resumed (Lifecycle Event)
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:46:26 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Instance spawned successfully.
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:46:26 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690299986.3991911, bfa66e15-724c-4192-b860-5a221b9c0ba3 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:46:26 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] VM Started (Lifecycle Event)
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:46:26 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:46:26 user nova-compute[70869]: INFO nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Took 5.22 seconds to spawn the instance on the hypervisor.
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:46:26 user nova-compute[70869]: INFO nova.compute.manager [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Took 6.06 seconds to build instance.
Jul 25 15:46:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15248a14-161c-43b1-8f92-3e368d4c3b54 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.164s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-a5b962e2-fe3a-4f43-86c0-7386a28f293e req-0f870270-8781-447b-8425-3931a8a4927d service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received event network-vif-plugged-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a5b962e2-fe3a-4f43-86c0-7386a28f293e req-0f870270-8781-447b-8425-3931a8a4927d service nova] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a5b962e2-fe3a-4f43-86c0-7386a28f293e req-0f870270-8781-447b-8425-3931a8a4927d service nova] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a5b962e2-fe3a-4f43-86c0-7386a28f293e req-0f870270-8781-447b-8425-3931a8a4927d service nova] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:26 user nova-compute[70869]: DEBUG nova.compute.manager [req-a5b962e2-fe3a-4f43-86c0-7386a28f293e req-0f870270-8781-447b-8425-3931a8a4927d service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] No waiting events found dispatching network-vif-plugged-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:46:26 user nova-compute[70869]: WARNING nova.compute.manager [req-a5b962e2-fe3a-4f43-86c0-7386a28f293e req-0f870270-8781-447b-8425-3931a8a4927d service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received unexpected event network-vif-plugged-4d5dfc99-2612-4f21-96c1-dd195692db33 for instance with vm_state active and task_state None.
Jul 25 15:46:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:31 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690299976.2909908, e69fa561-b002-49d7-8251-3de03ae44940 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:46:31 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: e69fa561-b002-49d7-8251-3de03ae44940] VM Stopped (Lifecycle Event)
Jul 25 15:46:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c22e1352-f35a-4e8f-b9c9-9fdee2b4fd87 None None] [instance: e69fa561-b002-49d7-8251-3de03ae44940] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:46:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:35 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:46:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:46:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:46:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:46:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:46:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:46:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid 5ce85315-be2f-4be3-953f-ed7b5d4685d6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:46:36 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updating instance_info_cache with network_info: [{"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:46:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-5ce85315-be2f-4be3-953f-ed7b5d4685d6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:46:36 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:46:36 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:46:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:46:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:46:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:46:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:46:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:46:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:46:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:46:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:39 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:46:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:46:42 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:46:42 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7687MB free_disk=25.262924194335938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 58e838f4-a6e4-4292-a14a-f1e5894c615b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a7211b55-7b3f-455b-b185-4e6432faf006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bba84347-9d28-4789-8d45-3e39770c8f4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bfa66e15-724c-4192-b860-5a221b9c0ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:46:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:46:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:46:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:46:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:45 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:46:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG nova.objects.instance [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:46:58 user nova-compute[70869]: INFO nova.compute.manager [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attaching volume 14416407-b0b9-452a-9b7d-ddaaa14a2a84 to /dev/vdb
Jul 25 15:46:58 user nova-compute[70869]: DEBUG os_brick.utils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7183a323-59ee-4e5f-bc73-7b8311c6c224]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[840de2af-fc9a-4f1d-8b95-a4a1bf8ed599]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd94f1e-78fa-42c9-827e-1c4fd307a219]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0effdd07-3868-4449-924a-ded47cef6c4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:46:58 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:46:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7685afa1-e61f-4a7a-9363-eeeffc1a165e]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG os_brick.utils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating existing volume attachment record: 8b194551-edd7-400c-8f38-dc6803a53c8c {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:46:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:46:59 user nova-compute[70869]: INFO nova.compute.manager [None req-2cfc18ea-333a-4348-9609-7e18093123b2 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Unrescuing
Jul 25 15:46:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2cfc18ea-333a-4348-9609-7e18093123b2 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:46:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2cfc18ea-333a-4348-9609-7e18093123b2 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquired lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:46:59 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2cfc18ea-333a-4348-9609-7e18093123b2 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2cfc18ea-333a-4348-9609-7e18093123b2 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Updating instance_info_cache with network_info: [{"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2cfc18ea-333a-4348-9609-7e18093123b2 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Releasing lock "refresh_cache-58e838f4-a6e4-4292-a14a-f1e5894c615b" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2cfc18ea-333a-4348-9609-7e18093123b2 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'flavor' on Instance uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e66a670-b7fa-46df-8d70-e8dd7ff57cbc req-4080d26e-de06-4c75-bc6f-ee4bee08bda8 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-unplugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e66a670-b7fa-46df-8d70-e8dd7ff57cbc req-4080d26e-de06-4c75-bc6f-ee4bee08bda8 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e66a670-b7fa-46df-8d70-e8dd7ff57cbc req-4080d26e-de06-4c75-bc6f-ee4bee08bda8 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0e66a670-b7fa-46df-8d70-e8dd7ff57cbc req-4080d26e-de06-4c75-bc6f-ee4bee08bda8 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-0e66a670-b7fa-46df-8d70-e8dd7ff57cbc req-4080d26e-de06-4c75-bc6f-ee4bee08bda8 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-unplugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:00 user nova-compute[70869]: WARNING nova.compute.manager [req-0e66a670-b7fa-46df-8d70-e8dd7ff57cbc req-4080d26e-de06-4c75-bc6f-ee4bee08bda8 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-unplugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:47:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:01 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Instance destroyed successfully.
Jul 25 15:47:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:02 user nova-compute[70869]: WARNING nova.compute.manager [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:47:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:02 user nova-compute[70869]: WARNING nova.compute.manager [req-8f69cfed-4e56-4cdc-b648-d854cbd32546 req-7da0258a-895b-4d83-9895-cda049e11ad3 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:47:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for 58e838f4-a6e4-4292-a14a-f1e5894c615b due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300024.446562, 58e838f4-a6e4-4292-a14a-f1e5894c615b => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:47:04 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] VM Resumed (Lifecycle Event)
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2cfc18ea-333a-4348-9609-7e18093123b2 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:47:04 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300024.4498081, 58e838f4-a6e4-4292-a14a-f1e5894c615b => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:47:04 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] VM Started (Lifecycle Event)
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.compute.manager [req-6335220d-7dc7-469c-bb0f-c58c7653f87d req-1c606d1d-46dd-4feb-9ea0-a87cc802daab service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6335220d-7dc7-469c-bb0f-c58c7653f87d req-1c606d1d-46dd-4feb-9ea0-a87cc802daab service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6335220d-7dc7-469c-bb0f-c58c7653f87d req-1c606d1d-46dd-4feb-9ea0-a87cc802daab service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6335220d-7dc7-469c-bb0f-c58c7653f87d req-1c606d1d-46dd-4feb-9ea0-a87cc802daab service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:04 user nova-compute[70869]: DEBUG nova.compute.manager [req-6335220d-7dc7-469c-bb0f-c58c7653f87d req-1c606d1d-46dd-4feb-9ea0-a87cc802daab service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:04 user nova-compute[70869]: WARNING nova.compute.manager [req-6335220d-7dc7-469c-bb0f-c58c7653f87d req-1c606d1d-46dd-4feb-9ea0-a87cc802daab service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state active and task_state None.
Jul 25 15:47:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwNROXjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:47:05 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:47:05 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:47:05 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d7599f-4d85-46c1-881d-e60229d0b1e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:47:05 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee50ce1-1864-4c4a-817d-d2e2d62cc2f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84] added
Jul 25 15:47:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b4d35f-b805-4c3f-97f8-1c2887d2ea2b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ef9f1a-5dcb-454b-9cee-7a04a77a8220]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwNROXjb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwNROXjb" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b2cc6-6478-4541-b2cd-0595369b0541]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwNROXjb'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43d5078-123b-422b-9de6-81f141d5c9be]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5c3834-1c4b-4d6b-9622-8866a3e7afe5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f0cf4d-e2b3-47ca-a41c-c2f304b58e28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84, portal: 172.16.0.220,3260]
Jul 25 15:47:05 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84, portal: 172.16.0.220,3260] successful.
Jul 25 15:47:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d007a5a-b036-47fb-8995-00be1ec6c32f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2565598a-6001-4873-9fa8-7518abfe2453]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 (non-flash)
Jul 25 15:47:05 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57efe13-0093-4be6-85c1-274ac05f24d0]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:47:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwNROXjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:47:06 user nova-compute[70869]: INFO nova.compute.claims [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Claim successful on node user
Jul 25 15:47:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26164303063663635', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164303063663635', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG nova.objects.instance [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:47:06 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:47:06 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:47:06 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:47:06 user nova-compute[70869]:   <serial>14416407-b0b9-452a-9b7d-ddaaa14a2a84</serial>
Jul 25 15:47:06 user nova-compute[70869]: </disk>
Jul 25 15:47:06 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:47:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No VIF found with MAC fa:16:3e:10:17:8d, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:47:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Creating image(s)
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.policy [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cee3181b38f451a929907b0250f7ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a65674a8194f93a976d52353da0c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-559319f7-18ee-4cd5-a71c-63acd47ce85c tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.087s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.161s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:47:07 user nova-compute[70869]: INFO nova.compute.claims [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Claim successful on node user
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk 1073741824" returned: 0 in 0.054s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Cannot resize image /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'migration_context' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Ensure instance console log exists: /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Successfully created port: efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:47:08 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:47:08 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Creating image(s)
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.policy [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cee3181b38f451a929907b0250f7ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a65674a8194f93a976d52353da0c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk 1073741824" returned: 0 in 0.057s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Cannot resize image /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.objects.instance [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'migration_context' on Instance uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Ensure instance console log exists: /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Successfully created port: 2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Successfully updated port: efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquired lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-7e08ed26-0884-49a8-b1d5-08a2b7104ba5 req-94e4a7cd-377f-490c-be27-633c4ff4a624 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-changed-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-7e08ed26-0884-49a8-b1d5-08a2b7104ba5 req-94e4a7cd-377f-490c-be27-633c4ff4a624 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Refreshing instance network info cache due to event network-changed-efe49064-97de-4484-9655-e582f8eac530. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7e08ed26-0884-49a8-b1d5-08a2b7104ba5 req-94e4a7cd-377f-490c-be27-633c4ff4a624 service nova] Acquiring lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:09 user nova-compute[70869]: INFO nova.compute.manager [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Detaching volume 14416407-b0b9-452a-9b7d-ddaaa14a2a84
Jul 25 15:47:09 user nova-compute[70869]: INFO nova.virt.block_device [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attempting to driver detach volume 14416407-b0b9-452a-9b7d-ddaaa14a2a84 from mountpoint /dev/vdb
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Attempting to detach device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:47:09 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:47:09 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:47:09 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:47:09 user nova-compute[70869]:   <serial>14416407-b0b9-452a-9b7d-ddaaa14a2a84</serial>
Jul 25 15:47:09 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:47:09 user nova-compute[70869]: </disk>
Jul 25 15:47:09 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:47:09 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully detached device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the persistent domain config.
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:47:09 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:47:09 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:47:09 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:47:09 user nova-compute[70869]:   <serial>14416407-b0b9-452a-9b7d-ddaaa14a2a84</serial>
Jul 25 15:47:09 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:47:09 user nova-compute[70869]: </disk>
Jul 25 15:47:09 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:09 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:47:10 user nova-compute[70869]: INFO nova.compute.claims [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Claim successful on node user
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300030.3591166, a7211b55-7b3f-455b-b185-4e6432faf006 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:47:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully detached device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the live domain config.
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwNROXjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:47:10 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updating instance_info_cache with network_info: [{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b38d073-2c71-4d06-a39e-5bd66738700b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:47:10 user nova-compute[70869]: No targets found.
Jul 25 15:47:10 user nova-compute[70869]: iSNS:
Jul 25 15:47:10 user nova-compute[70869]: No targets found.
Jul 25 15:47:10 user nova-compute[70869]: STATIC:
Jul 25 15:47:10 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:47:10 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:10 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:10 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4
Jul 25 15:47:10 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:10 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:10 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:47:10 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:10 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:10 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84
Jul 25 15:47:10 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:10 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:10 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:47:10 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:10 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:10 user nova-compute[70869]: FIRMWARE:
Jul 25 15:47:10 user nova-compute[70869]: No targets found.
Jul 25 15:47:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:47:10 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:47:10 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Releasing lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Instance network_info: |[{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7e08ed26-0884-49a8-b1d5-08a2b7104ba5 req-94e4a7cd-377f-490c-be27-633c4ff4a624 service nova] Acquired lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-7e08ed26-0884-49a8-b1d5-08a2b7104ba5 req-94e4a7cd-377f-490c-be27-633c4ff4a624 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Refreshing network info cache for port efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Start _get_guest_xml network_info=[{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[336de37d-e341-45fc-85ba-beab16e47fa5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:47:10 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055914467',display_name='tempest-ServerRescueNegativeTestJSON-server-2055914467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055914467',id=31,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-igielsyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:47:07Z,user_data=None,user_id='2cee3181b38f451a929907b0250f7ae0',uuid=e1ff49de-2dee-476c-8bf1-b70e64fe991e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:ff:ec,bridge_name='br-int',has_traffic_filtering=True,id=efe49064-97de-4484-9655-e582f8eac530,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe49064-97') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'pci_devices' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b2faa2-69e5-4384-bca9-0755b5abba93]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:10 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:47:10 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:10 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:10 user nova-compute[70869]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 (non-flash)
Jul 25 15:47:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:10 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:47:10 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:10 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:10 user nova-compute[70869]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 (non-flash)
Jul 25 15:47:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4343c7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:47:10 user nova-compute[70869]:   <uuid>e1ff49de-2dee-476c-8bf1-b70e64fe991e</uuid>
Jul 25 15:47:10 user nova-compute[70869]:   <name>instance-0000001f</name>
Jul 25 15:47:10 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:47:10 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:47:10 user nova-compute[70869]:   <metadata>
Jul 25 15:47:10 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:47:10 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:47:10 user nova-compute[70869]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2055914467</nova:name>
Jul 25 15:47:10 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:47:10</nova:creationTime>
Jul 25 15:47:10 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:47:10 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:47:10 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:47:10 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:47:10 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:47:10 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:47:10 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:47:10 user nova-compute[70869]:       <nova:owner>
Jul 25 15:47:10 user nova-compute[70869]:         <nova:user uuid="2cee3181b38f451a929907b0250f7ae0">tempest-ServerRescueNegativeTestJSON-2116380302-project-member</nova:user>
Jul 25 15:47:10 user nova-compute[70869]:         <nova:project uuid="40a65674a8194f93a976d52353da0c39">tempest-ServerRescueNegativeTestJSON-2116380302</nova:project>
Jul 25 15:47:10 user nova-compute[70869]:       </nova:owner>
Jul 25 15:47:10 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:47:10 user nova-compute[70869]:       <nova:ports>
Jul 25 15:47:10 user nova-compute[70869]:         <nova:port uuid="efe49064-97de-4484-9655-e582f8eac530">
Jul 25 15:47:10 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 15:47:10 user nova-compute[70869]:         </nova:port>
Jul 25 15:47:10 user nova-compute[70869]:       </nova:ports>
Jul 25 15:47:10 user nova-compute[70869]:     </nova:instance>
Jul 25 15:47:10 user nova-compute[70869]:   </metadata>
Jul 25 15:47:10 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:47:10 user nova-compute[70869]:     <system>
Jul 25 15:47:10 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:47:10 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:47:10 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:47:10 user nova-compute[70869]:       <entry name="serial">e1ff49de-2dee-476c-8bf1-b70e64fe991e</entry>
Jul 25 15:47:10 user nova-compute[70869]:       <entry name="uuid">e1ff49de-2dee-476c-8bf1-b70e64fe991e</entry>
Jul 25 15:47:10 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:47:10 user nova-compute[70869]:     </system>
Jul 25 15:47:10 user nova-compute[70869]:   </sysinfo>
Jul 25 15:47:10 user nova-compute[70869]:   <os>
Jul 25 15:47:10 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:47:10 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:47:10 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:47:10 user nova-compute[70869]:   </os>
Jul 25 15:47:10 user nova-compute[70869]:   <features>
Jul 25 15:47:10 user nova-compute[70869]:     <acpi/>
Jul 25 15:47:10 user nova-compute[70869]:     <apic/>
Jul 25 15:47:10 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:47:10 user nova-compute[70869]:   </features>
Jul 25 15:47:10 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:47:10 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:47:10 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:47:10 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:47:10 user nova-compute[70869]:   </clock>
Jul 25 15:47:10 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:47:10 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:47:10 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:47:10 user nova-compute[70869]:   </cpu>
Jul 25 15:47:10 user nova-compute[70869]:   <devices>
Jul 25 15:47:10 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:47:10 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:47:10 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk"/>
Jul 25 15:47:10 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:47:10 user nova-compute[70869]:     </disk>
Jul 25 15:47:10 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:47:10 user nova-compute[70869]:       <mac address="fa:16:3e:99:ff:ec"/>
Jul 25 15:47:10 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:47:10 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:47:10 user nova-compute[70869]:       <target dev="tapefe49064-97"/>
Jul 25 15:47:10 user nova-compute[70869]:     </interface>
Jul 25 15:47:10 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:47:10 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/console.log" append="off"/>
Jul 25 15:47:10 user nova-compute[70869]:     </serial>
Jul 25 15:47:10 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:47:10 user nova-compute[70869]:     <video>
Jul 25 15:47:10 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:47:10 user nova-compute[70869]:     </video>
Jul 25 15:47:10 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:47:10 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:47:10 user nova-compute[70869]:     </rng>
Jul 25 15:47:10 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:47:10 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:47:10 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:47:10 user nova-compute[70869]:     </memballoon>
Jul 25 15:47:10 user nova-compute[70869]:   </devices>
Jul 25 15:47:10 user nova-compute[70869]: </domain>
Jul 25 15:47:10 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055914467',display_name='tempest-ServerRescueNegativeTestJSON-server-2055914467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055914467',id=31,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-igielsyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:47:07Z,user_data=None,user_id='2cee3181b38f451a929907b0250f7ae0',uuid=e1ff49de-2dee-476c-8bf1-b70e64fe991e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:ff:ec,bridge_name='br-int',has_traffic_filtering=True,id=efe49064-97de-4484-9655-e582f8eac530,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe49064-97') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_vif [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:ff:ec,bridge_name='br-int',has_traffic_filtering=True,id=efe49064-97de-4484-9655-e582f8eac530,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe49064-97') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefe49064-97, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefe49064-97, col_values=(('external_ids', {'iface-id': 'efe49064-97de-4484-9655-e582f8eac530', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:ff:ec', 'vm-uuid': 'e1ff49de-2dee-476c-8bf1-b70e64fe991e'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[571ac60b-47bc-4dd7-ae98-845a31be4f64]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:10 user nova-compute[70869]: INFO os_vif [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:ff:ec,bridge_name='br-int',has_traffic_filtering=True,id=efe49064-97de-4484-9655-e582f8eac530,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe49064-97')
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a387e9d-e5bc-4e72-926e-65c912aca58a]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd29b7d-2518-4d29-b3d2-4141a0cc6840]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No VIF found with MAC fa:16:3e:99:ff:ec, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a154f89-1778-4a66-b8b9-316ed8014a7c]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[99931f58-cc56-4c1a-a741-6ac1e4008391]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:47:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec4a384-fd82-4ec7-8bed-6ed12737e831]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84, portal: 172.16.0.220,3260]
Jul 25 15:47:10 user nova-compute[70869]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84, portal: 172.16.0.220,3260] successful.
Jul 25 15:47:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14416407-b0b9-452a-9b7d-ddaaa14a2a84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d2b4e1-6893-4fa6-96f4-c043c681a8d8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== disconnect_volume: return (405ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.policy [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a905cee33a204704937a0224b3e6fab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07ad06e29c4d2dbe409fa13979b81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:47:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Creating image(s)
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "/opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "/opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "d80914968c57642f5138a2c13b5c78c54865b573" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "d80914968c57642f5138a2c13b5c78c54865b573" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Successfully updated port: 2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Successfully created port: 5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquired lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573.part --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG nova.virt.images [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] f94a612b-4562-47e5-9d51-2797f07a0a88 was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573.part /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-f8e6f637-430e-4a58-9f6e-f0f740bc92c4 req-c0387fa4-c78c-45f2-ab1e-cde0d11fbc44 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-changed-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-f8e6f637-430e-4a58-9f6e-f0f740bc92c4 req-c0387fa4-c78c-45f2-ab1e-cde0d11fbc44 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Refreshing instance network info cache due to event network-changed-2f5a47b5-1a92-478f-9edc-c07fccc05ed2. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f8e6f637-430e-4a58-9f6e-f0f740bc92c4 req-c0387fa4-c78c-45f2-ab1e-cde0d11fbc44 service nova] Acquiring lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:47:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a48e2744-78cd-498e-a394-db3d9dd0e509 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.098s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-7e08ed26-0884-49a8-b1d5-08a2b7104ba5 req-94e4a7cd-377f-490c-be27-633c4ff4a624 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updated VIF entry in instance network info cache for port efe49064-97de-4484-9655-e582f8eac530. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-7e08ed26-0884-49a8-b1d5-08a2b7104ba5 req-94e4a7cd-377f-490c-be27-633c4ff4a624 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updating instance_info_cache with network_info: [{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7e08ed26-0884-49a8-b1d5-08a2b7104ba5 req-94e4a7cd-377f-490c-be27-633c4ff4a624 service nova] Releasing lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573.part /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573.converted" returned: 0 in 0.497s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "d80914968c57642f5138a2c13b5c78c54865b573" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.481s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573 --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "d80914968c57642f5138a2c13b5c78c54865b573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "d80914968c57642f5138a2c13b5c78c54865b573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Successfully updated port: 5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquired lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573 --force-share --output=json" returned: 0 in 0.163s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573,backing_fmt=raw /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-0709b90e-418c-4566-a1ac-f1c577436376 req-bef64b77-5075-4ba0-93ba-98698b3d2f4b service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-0709b90e-418c-4566-a1ac-f1c577436376 req-bef64b77-5075-4ba0-93ba-98698b3d2f4b service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing instance network info cache due to event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0709b90e-418c-4566-a1ac-f1c577436376 req-bef64b77-5075-4ba0-93ba-98698b3d2f4b service nova] Acquiring lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573,backing_fmt=raw /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk 1073741824" returned: 0 in 0.062s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "d80914968c57642f5138a2c13b5c78c54865b573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updating instance_info_cache with network_info: [{"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Releasing lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Instance network_info: |[{"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573 --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f8e6f637-430e-4a58-9f6e-f0f740bc92c4 req-c0387fa4-c78c-45f2-ab1e-cde0d11fbc44 service nova] Acquired lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-f8e6f637-430e-4a58-9f6e-f0f740bc92c4 req-c0387fa4-c78c-45f2-ab1e-cde0d11fbc44 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Refreshing network info cache for port 2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Start _get_guest_xml network_info=[{"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:13 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:47:13 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1014341533',display_name='tempest-ServerRescueNegativeTestJSON-server-1014341533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1014341533',id=32,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-g04b45ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:47:08Z,user_data=None,user_id='2cee3181b38f451a929907b0250f7ae0',uuid=a140f33e-19d2-41fa-9fbe-4b2791e2888c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ca:36,bridge_name='br-int',has_traffic_filtering=True,id=2f5a47b5-1a92-478f-9edc-c07fccc05ed2,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5a47b5-1a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'pci_devices' on Instance uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:47:13 user nova-compute[70869]:   <uuid>a140f33e-19d2-41fa-9fbe-4b2791e2888c</uuid>
Jul 25 15:47:13 user nova-compute[70869]:   <name>instance-00000020</name>
Jul 25 15:47:13 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:47:13 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:47:13 user nova-compute[70869]:   <metadata>
Jul 25 15:47:13 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:47:13 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1014341533</nova:name>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:47:13</nova:creationTime>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:47:13 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:47:13 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:owner>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:user uuid="2cee3181b38f451a929907b0250f7ae0">tempest-ServerRescueNegativeTestJSON-2116380302-project-member</nova:user>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:project uuid="40a65674a8194f93a976d52353da0c39">tempest-ServerRescueNegativeTestJSON-2116380302</nova:project>
Jul 25 15:47:13 user nova-compute[70869]:       </nova:owner>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:ports>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:port uuid="2f5a47b5-1a92-478f-9edc-c07fccc05ed2">
Jul 25 15:47:13 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 15:47:13 user nova-compute[70869]:         </nova:port>
Jul 25 15:47:13 user nova-compute[70869]:       </nova:ports>
Jul 25 15:47:13 user nova-compute[70869]:     </nova:instance>
Jul 25 15:47:13 user nova-compute[70869]:   </metadata>
Jul 25 15:47:13 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:47:13 user nova-compute[70869]:     <system>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="serial">a140f33e-19d2-41fa-9fbe-4b2791e2888c</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="uuid">a140f33e-19d2-41fa-9fbe-4b2791e2888c</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:47:13 user nova-compute[70869]:     </system>
Jul 25 15:47:13 user nova-compute[70869]:   </sysinfo>
Jul 25 15:47:13 user nova-compute[70869]:   <os>
Jul 25 15:47:13 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:47:13 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:47:13 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:47:13 user nova-compute[70869]:   </os>
Jul 25 15:47:13 user nova-compute[70869]:   <features>
Jul 25 15:47:13 user nova-compute[70869]:     <acpi/>
Jul 25 15:47:13 user nova-compute[70869]:     <apic/>
Jul 25 15:47:13 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:47:13 user nova-compute[70869]:   </features>
Jul 25 15:47:13 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:47:13 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:47:13 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:47:13 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:47:13 user nova-compute[70869]:   </clock>
Jul 25 15:47:13 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:47:13 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:47:13 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:47:13 user nova-compute[70869]:   </cpu>
Jul 25 15:47:13 user nova-compute[70869]:   <devices>
Jul 25 15:47:13 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:47:13 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:47:13 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk"/>
Jul 25 15:47:13 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:47:13 user nova-compute[70869]:     </disk>
Jul 25 15:47:13 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:47:13 user nova-compute[70869]:       <mac address="fa:16:3e:c3:ca:36"/>
Jul 25 15:47:13 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:47:13 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:47:13 user nova-compute[70869]:       <target dev="tap2f5a47b5-1a"/>
Jul 25 15:47:13 user nova-compute[70869]:     </interface>
Jul 25 15:47:13 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:47:13 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/console.log" append="off"/>
Jul 25 15:47:13 user nova-compute[70869]:     </serial>
Jul 25 15:47:13 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:47:13 user nova-compute[70869]:     <video>
Jul 25 15:47:13 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:47:13 user nova-compute[70869]:     </video>
Jul 25 15:47:13 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:47:13 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:47:13 user nova-compute[70869]:     </rng>
Jul 25 15:47:13 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:47:13 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:47:13 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:47:13 user nova-compute[70869]:     </memballoon>
Jul 25 15:47:13 user nova-compute[70869]:   </devices>
Jul 25 15:47:13 user nova-compute[70869]: </domain>
Jul 25 15:47:13 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1014341533',display_name='tempest-ServerRescueNegativeTestJSON-server-1014341533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1014341533',id=32,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-g04b45ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:47:08Z,user_data=None,user_id='2cee3181b38f451a929907b0250f7ae0',uuid=a140f33e-19d2-41fa-9fbe-4b2791e2888c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ca:36,bridge_name='br-int',has_traffic_filtering=True,id=2f5a47b5-1a92-478f-9edc-c07fccc05ed2,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5a47b5-1a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG os_vif [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ca:36,bridge_name='br-int',has_traffic_filtering=True,id=2f5a47b5-1a92-478f-9edc-c07fccc05ed2,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5a47b5-1a') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f5a47b5-1a, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f5a47b5-1a, col_values=(('external_ids', {'iface-id': '2f5a47b5-1a92-478f-9edc-c07fccc05ed2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:ca:36', 'vm-uuid': 'a140f33e-19d2-41fa-9fbe-4b2791e2888c'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Cannot resize image /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'migration_context' on Instance uuid fc8f7a35-cb25-469d-ba79-832b8e6aaba0 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:13 user nova-compute[70869]: INFO os_vif [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ca:36,bridge_name='br-int',has_traffic_filtering=True,id=2f5a47b5-1a92-478f-9edc-c07fccc05ed2,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5a47b5-1a')
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Ensure instance console log exists: /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No VIF found with MAC fa:16:3e:c3:ca:36, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating instance_info_cache with network_info: [{"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Releasing lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Instance network_info: |[{"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0709b90e-418c-4566-a1ac-f1c577436376 req-bef64b77-5075-4ba0-93ba-98698b3d2f4b service nova] Acquired lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-0709b90e-418c-4566-a1ac-f1c577436376 req-bef64b77-5075-4ba0-93ba-98698b3d2f4b service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Start _get_guest_xml network_info=[{"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:47:07Z,direct_url=<?>,disk_format='qcow2',id=f94a612b-4562-47e5-9d51-2797f07a0a88,min_disk=0,min_ram=0,name='tempest-scenario-img--1025170911',owner='4c07ad06e29c4d2dbe409fa13979b81b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:47:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'f94a612b-4562-47e5-9d51-2797f07a0a88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:47:13 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:47:13 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:47:07Z,direct_url=<?>,disk_format='qcow2',id=f94a612b-4562-47e5-9d51-2797f07a0a88,min_disk=0,min_ram=0,name='tempest-scenario-img--1025170911',owner='4c07ad06e29c4d2dbe409fa13979b81b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:47:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-178917315',display_name='tempest-TestMinimumBasicScenario-server-178917315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-178917315',id=33,image_ref='f94a612b-4562-47e5-9d51-2797f07a0a88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfYlMxGcH3fEmHTIEIEtyNsmsxO6pJzoTkgLBbTfVtbM/zV5roNnGTBokhbDaHb3PSlSPU/m6tYJ63tM3Ek+WbAfE7C8Yu/nDd1qrpgtx826Ny/rWvLkUYqxBKNOavWcA==',key_name='tempest-TestMinimumBasicScenario-776375289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c07ad06e29c4d2dbe409fa13979b81b',ramdisk_id='',reservation_id='r-50otbupw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f94a612b-4562-47e5-9d51-2797f07a0a88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1773990321',owner_user_name='tempest-TestMinimumBasicScenario-1773990321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:47:11Z,user_data=None,user_id='a905cee33a204704937a0224b3e6fab1',uuid=fc8f7a35-cb25-469d-ba79-832b8e6aaba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converting VIF {"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c6:94,bridge_name='br-int',has_traffic_filtering=True,id=5cac5d10-cbcd-48d7-b476-268d6d757071,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cac5d10-cb') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'pci_devices' on Instance uuid fc8f7a35-cb25-469d-ba79-832b8e6aaba0 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:47:13 user nova-compute[70869]:   <uuid>fc8f7a35-cb25-469d-ba79-832b8e6aaba0</uuid>
Jul 25 15:47:13 user nova-compute[70869]:   <name>instance-00000021</name>
Jul 25 15:47:13 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:47:13 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:47:13 user nova-compute[70869]:   <metadata>
Jul 25 15:47:13 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:47:13 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:name>tempest-TestMinimumBasicScenario-server-178917315</nova:name>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:47:13</nova:creationTime>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:47:13 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:47:13 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:owner>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:user uuid="a905cee33a204704937a0224b3e6fab1">tempest-TestMinimumBasicScenario-1773990321-project-member</nova:user>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:project uuid="4c07ad06e29c4d2dbe409fa13979b81b">tempest-TestMinimumBasicScenario-1773990321</nova:project>
Jul 25 15:47:13 user nova-compute[70869]:       </nova:owner>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:root type="image" uuid="f94a612b-4562-47e5-9d51-2797f07a0a88"/>
Jul 25 15:47:13 user nova-compute[70869]:       <nova:ports>
Jul 25 15:47:13 user nova-compute[70869]:         <nova:port uuid="5cac5d10-cbcd-48d7-b476-268d6d757071">
Jul 25 15:47:13 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 25 15:47:13 user nova-compute[70869]:         </nova:port>
Jul 25 15:47:13 user nova-compute[70869]:       </nova:ports>
Jul 25 15:47:13 user nova-compute[70869]:     </nova:instance>
Jul 25 15:47:13 user nova-compute[70869]:   </metadata>
Jul 25 15:47:13 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:47:13 user nova-compute[70869]:     <system>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="serial">fc8f7a35-cb25-469d-ba79-832b8e6aaba0</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="uuid">fc8f7a35-cb25-469d-ba79-832b8e6aaba0</entry>
Jul 25 15:47:13 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:47:13 user nova-compute[70869]:     </system>
Jul 25 15:47:13 user nova-compute[70869]:   </sysinfo>
Jul 25 15:47:13 user nova-compute[70869]:   <os>
Jul 25 15:47:13 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:47:13 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:47:13 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:47:13 user nova-compute[70869]:   </os>
Jul 25 15:47:13 user nova-compute[70869]:   <features>
Jul 25 15:47:13 user nova-compute[70869]:     <acpi/>
Jul 25 15:47:13 user nova-compute[70869]:     <apic/>
Jul 25 15:47:13 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:47:13 user nova-compute[70869]:   </features>
Jul 25 15:47:13 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:47:13 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:47:13 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:47:13 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:47:13 user nova-compute[70869]:   </clock>
Jul 25 15:47:13 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:47:13 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:47:13 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:47:13 user nova-compute[70869]:   </cpu>
Jul 25 15:47:13 user nova-compute[70869]:   <devices>
Jul 25 15:47:13 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:47:13 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:47:13 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk"/>
Jul 25 15:47:13 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:47:13 user nova-compute[70869]:     </disk>
Jul 25 15:47:13 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:47:13 user nova-compute[70869]:       <mac address="fa:16:3e:95:c6:94"/>
Jul 25 15:47:13 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:47:13 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:47:13 user nova-compute[70869]:       <target dev="tap5cac5d10-cb"/>
Jul 25 15:47:13 user nova-compute[70869]:     </interface>
Jul 25 15:47:13 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:47:13 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/console.log" append="off"/>
Jul 25 15:47:13 user nova-compute[70869]:     </serial>
Jul 25 15:47:13 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:47:13 user nova-compute[70869]:     <video>
Jul 25 15:47:13 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:47:13 user nova-compute[70869]:     </video>
Jul 25 15:47:13 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:47:13 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:47:13 user nova-compute[70869]:     </rng>
Jul 25 15:47:13 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:47:13 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:47:13 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:47:13 user nova-compute[70869]:     </memballoon>
Jul 25 15:47:13 user nova-compute[70869]:   </devices>
Jul 25 15:47:13 user nova-compute[70869]: </domain>
Jul 25 15:47:13 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-178917315',display_name='tempest-TestMinimumBasicScenario-server-178917315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-178917315',id=33,image_ref='f94a612b-4562-47e5-9d51-2797f07a0a88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfYlMxGcH3fEmHTIEIEtyNsmsxO6pJzoTkgLBbTfVtbM/zV5roNnGTBokhbDaHb3PSlSPU/m6tYJ63tM3Ek+WbAfE7C8Yu/nDd1qrpgtx826Ny/rWvLkUYqxBKNOavWcA==',key_name='tempest-TestMinimumBasicScenario-776375289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c07ad06e29c4d2dbe409fa13979b81b',ramdisk_id='',reservation_id='r-50otbupw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f94a612b-4562-47e5-9d51-2797f07a0a88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1773990321',owner_user_name='tempest-TestMinimumBasicScenario-1773990321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:47:11Z,user_data=None,user_id='a905cee33a204704937a0224b3e6fab1',uuid=fc8f7a35-cb25-469d-ba79-832b8e6aaba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converting VIF {"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c6:94,bridge_name='br-int',has_traffic_filtering=True,id=5cac5d10-cbcd-48d7-b476-268d6d757071,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cac5d10-cb') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG os_vif [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c6:94,bridge_name='br-int',has_traffic_filtering=True,id=5cac5d10-cbcd-48d7-b476-268d6d757071,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cac5d10-cb') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cac5d10-cb, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cac5d10-cb, col_values=(('external_ids', {'iface-id': '5cac5d10-cbcd-48d7-b476-268d6d757071', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:c6:94', 'vm-uuid': 'fc8f7a35-cb25-469d-ba79-832b8e6aaba0'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:13 user nova-compute[70869]: INFO os_vif [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c6:94,bridge_name='br-int',has_traffic_filtering=True,id=5cac5d10-cbcd-48d7-b476-268d6d757071,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cac5d10-cb')
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No VIF found with MAC fa:16:3e:95:c6:94, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-f8e6f637-430e-4a58-9f6e-f0f740bc92c4 req-c0387fa4-c78c-45f2-ab1e-cde0d11fbc44 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updated VIF entry in instance network info cache for port 2f5a47b5-1a92-478f-9edc-c07fccc05ed2. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-f8e6f637-430e-4a58-9f6e-f0f740bc92c4 req-c0387fa4-c78c-45f2-ab1e-cde0d11fbc44 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updating instance_info_cache with network_info: [{"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f8e6f637-430e-4a58-9f6e-f0f740bc92c4 req-c0387fa4-c78c-45f2-ab1e-cde0d11fbc44 service nova] Releasing lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-0709b90e-418c-4566-a1ac-f1c577436376 req-bef64b77-5075-4ba0-93ba-98698b3d2f4b service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updated VIF entry in instance network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-0709b90e-418c-4566-a1ac-f1c577436376 req-bef64b77-5075-4ba0-93ba-98698b3d2f4b service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating instance_info_cache with network_info: [{"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0709b90e-418c-4566-a1ac-f1c577436376 req-bef64b77-5075-4ba0-93ba-98698b3d2f4b service nova] Releasing lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:13 user nova-compute[70869]: WARNING nova.compute.manager [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state building and task_state spawning.
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:13 user nova-compute[70869]: WARNING nova.compute.manager [req-2d1e4029-1fca-4b30-8484-1668fc548f16 req-eb020bb6-3053-416e-ada1-2ebeed16603a service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state building and task_state spawning.
Jul 25 15:47:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300034.339782, e1ff49de-2dee-476c-8bf1-b70e64fe991e => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:47:14 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] VM Resumed (Lifecycle Event)
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:14 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Instance spawned successfully.
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:14 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300034.348869, e1ff49de-2dee-476c-8bf1-b70e64fe991e => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:47:14 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] VM Started (Lifecycle Event)
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:47:14 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:47:14 user nova-compute[70869]: INFO nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Took 7.25 seconds to spawn the instance on the hypervisor.
Jul 25 15:47:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:14 user nova-compute[70869]: INFO nova.compute.manager [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Took 8.16 seconds to build instance.
Jul 25 15:47:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b8fb0e2e-bb5e-45f9-b5a6-1edd6c45e910 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.258s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-9ab23a2b-57cc-4ea1-8e77-e260fdde8498 req-7cb9efcb-d0dd-4109-9674-d5d873043513 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9ab23a2b-57cc-4ea1-8e77-e260fdde8498 req-7cb9efcb-d0dd-4109-9674-d5d873043513 service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9ab23a2b-57cc-4ea1-8e77-e260fdde8498 req-7cb9efcb-d0dd-4109-9674-d5d873043513 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9ab23a2b-57cc-4ea1-8e77-e260fdde8498 req-7cb9efcb-d0dd-4109-9674-d5d873043513 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-9ab23a2b-57cc-4ea1-8e77-e260fdde8498 req-7cb9efcb-d0dd-4109-9674-d5d873043513 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:15 user nova-compute[70869]: WARNING nova.compute.manager [req-9ab23a2b-57cc-4ea1-8e77-e260fdde8498 req-7cb9efcb-d0dd-4109-9674-d5d873043513 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state building and task_state spawning.
Jul 25 15:47:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-dd34d370-713d-4de5-83be-cc1c2cefe4d2 req-367c3f09-c856-4fa1-bcec-15a0dc2ce878 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dd34d370-713d-4de5-83be-cc1c2cefe4d2 req-367c3f09-c856-4fa1-bcec-15a0dc2ce878 service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dd34d370-713d-4de5-83be-cc1c2cefe4d2 req-367c3f09-c856-4fa1-bcec-15a0dc2ce878 service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dd34d370-713d-4de5-83be-cc1c2cefe4d2 req-367c3f09-c856-4fa1-bcec-15a0dc2ce878 service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-dd34d370-713d-4de5-83be-cc1c2cefe4d2 req-367c3f09-c856-4fa1-bcec-15a0dc2ce878 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:16 user nova-compute[70869]: WARNING nova.compute.manager [req-dd34d370-713d-4de5-83be-cc1c2cefe4d2 req-367c3f09-c856-4fa1-bcec-15a0dc2ce878 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state building and task_state spawning.
Jul 25 15:47:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-cacc5f4c-a894-4352-afb4-2ef69127887d req-a5d0cf1e-e641-4395-86e1-f4ad537d3f22 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cacc5f4c-a894-4352-afb4-2ef69127887d req-a5d0cf1e-e641-4395-86e1-f4ad537d3f22 service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cacc5f4c-a894-4352-afb4-2ef69127887d req-a5d0cf1e-e641-4395-86e1-f4ad537d3f22 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cacc5f4c-a894-4352-afb4-2ef69127887d req-a5d0cf1e-e641-4395-86e1-f4ad537d3f22 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-cacc5f4c-a894-4352-afb4-2ef69127887d req-a5d0cf1e-e641-4395-86e1-f4ad537d3f22 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:17 user nova-compute[70869]: WARNING nova.compute.manager [req-cacc5f4c-a894-4352-afb4-2ef69127887d req-a5d0cf1e-e641-4395-86e1-f4ad537d3f22 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state building and task_state spawning.
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-0adc6aca-c24d-4689-89c6-72bcb520eb4d req-92e775e0-2b39-49a5-91fa-0430eb393370 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0adc6aca-c24d-4689-89c6-72bcb520eb4d req-92e775e0-2b39-49a5-91fa-0430eb393370 service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0adc6aca-c24d-4689-89c6-72bcb520eb4d req-92e775e0-2b39-49a5-91fa-0430eb393370 service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0adc6aca-c24d-4689-89c6-72bcb520eb4d req-92e775e0-2b39-49a5-91fa-0430eb393370 service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-0adc6aca-c24d-4689-89c6-72bcb520eb4d req-92e775e0-2b39-49a5-91fa-0430eb393370 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:18 user nova-compute[70869]: WARNING nova.compute.manager [req-0adc6aca-c24d-4689-89c6-72bcb520eb4d req-92e775e0-2b39-49a5-91fa-0430eb393370 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state building and task_state spawning.
Jul 25 15:47:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Terminating instance
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300038.6937912, fc8f7a35-cb25-469d-ba79-832b8e6aaba0 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] VM Resumed (Lifecycle Event)
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Instance spawned successfully.
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Instance spawned successfully.
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300038.6951, fc8f7a35-cb25-469d-ba79-832b8e6aaba0 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] VM Started (Lifecycle Event)
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300038.7075605, a140f33e-19d2-41fa-9fbe-4b2791e2888c => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] VM Resumed (Lifecycle Event)
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Took 10.56 seconds to spawn the instance on the hypervisor.
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Took 7.99 seconds to spawn the instance on the hypervisor.
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:47:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300038.7076597, a140f33e-19d2-41fa-9fbe-4b2791e2888c => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:47:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] VM Started (Lifecycle Event)
Jul 25 15:47:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:47:19 user nova-compute[70869]: INFO nova.compute.manager [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Took 11.57 seconds to build instance.
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-66e64128-742f-4b24-bda0-7b24b5b06100 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.716s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:19 user nova-compute[70869]: INFO nova.compute.manager [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Took 8.97 seconds to build instance.
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2bb3d498-ae5a-4161-8654-0950f42d6c02 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.131s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:19 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Instance destroyed successfully.
Jul 25 15:47:19 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'resources' on Instance uuid bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1873623589',display_name='tempest-ServerActionsTestOtherA-server-1873623589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1873623589',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:42:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-94gicbbv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "address": "fa:16:3e:43:92:82", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e983c7-b4", "ovs_interfaceid": "32e983c7-b4e5-47f6-ab3a-f82d87ea5273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_vif [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32e983c7-b4, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:47:19 user nova-compute[70869]: INFO os_vif [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:92:82,bridge_name='br-int',has_traffic_filtering=True,id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e983c7-b4')
Jul 25 15:47:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVGfPgEu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:47:19 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3ad1a0-2476-4214-a938-7faa7e06b175]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:47:19 user nova-compute[70869]: No targets found.
Jul 25 15:47:19 user nova-compute[70869]: iSNS:
Jul 25 15:47:19 user nova-compute[70869]: No targets found.
Jul 25 15:47:19 user nova-compute[70869]: STATIC:
Jul 25 15:47:19 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:47:19 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:19 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:19 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4
Jul 25 15:47:19 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:19 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:19 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8
Jul 25 15:47:19 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:19 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:19 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:47:19 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:19 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:19 user nova-compute[70869]: FIRMWARE:
Jul 25 15:47:19 user nova-compute[70869]: No targets found.
Jul 25 15:47:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:47:19 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:47:19 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe738b4-73cf-4a1c-9abc-f52ee441ce3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeafd69-3219-4549-b91e-23931f044486]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:19 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:47:19 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:19 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:19 user nova-compute[70869]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 (non-flash)
Jul 25 15:47:19 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:19 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe434275000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cbc1ff-e305-4d50-a734-ae84c7213040]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af5906-7ea8-4c05-b9d4-80b675907f89]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[03231846-010a-4dfc-97d4-e5c7ee46f143]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d575c355-0744-4b67-94ff-8ac0de270c18]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2093665f-00c95a6a0fd19ec7', '/dev/disk/by-id/scsi-23030633935613661', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2093665f') {{(pid=82054) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9a93ac-d52e-4b8d-9e81-b96142482806]: (4, None) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9d8b69-45dc-4024-9a7f-a052e0f68cd2]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[34501b0a-baf5-4aa1-a0f1-92ca1729a357]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260]
Jul 25 15:47:19 user nova-compute[70869]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8, portal: 172.16.0.220,3260] successful.
Jul 25 15:47:19 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1698b104-634b-4bdf-9890-34e7e05a41e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3304027f-a962-4295-be76-0d3d6a2d18f8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] <== disconnect_volume: return (414ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:47:19 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Deleting instance files /opt/stack/data/nova/instances/bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f_del
Jul 25 15:47:19 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Deletion of /opt/stack/data/nova/instances/bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f_del complete
Jul 25 15:47:19 user nova-compute[70869]: INFO nova.compute.manager [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 25 15:47:19 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:47:19 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-unplugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] No waiting events found dispatching network-vif-unplugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-unplugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] Acquiring lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] No waiting events found dispatching network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:47:20 user nova-compute[70869]: WARNING nova.compute.manager [req-7ece7720-f7eb-4dc9-b760-5c0337be08f5 req-207ac229-0cf3-487c-acba-8c8f8a91182e service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received unexpected event network-vif-plugged-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 for instance with vm_state active and task_state deleting.
Jul 25 15:47:20 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:20 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Took 0.88 seconds to deallocate network for instance.
Jul 25 15:47:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-81fe2caa-9a08-4a99-b18b-a3629c75fdf6 req-835303bd-2227-4b53-b5cb-0adcc0288404 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Received event network-vif-deleted-32e983c7-b4e5-47f6-ab3a-f82d87ea5273 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:47:20 user nova-compute[70869]: INFO nova.compute.manager [req-81fe2caa-9a08-4a99-b18b-a3629c75fdf6 req-835303bd-2227-4b53-b5cb-0adcc0288404 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Neutron deleted interface 32e983c7-b4e5-47f6-ab3a-f82d87ea5273; detaching it from the instance and deleting it from the info cache
Jul 25 15:47:20 user nova-compute[70869]: DEBUG nova.network.neutron [req-81fe2caa-9a08-4a99-b18b-a3629c75fdf6 req-835303bd-2227-4b53-b5cb-0adcc0288404 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-81fe2caa-9a08-4a99-b18b-a3629c75fdf6 req-835303bd-2227-4b53-b5cb-0adcc0288404 service nova] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Detach interface failed, port_id=32e983c7-b4e5-47f6-ab3a-f82d87ea5273, reason: Instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:47:21 user nova-compute[70869]: INFO nova.compute.manager [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Took 0.81 seconds to detach 1 volumes for instance.
Jul 25 15:47:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Deleting volume: 1698b104-634b-4bdf-9890-34e7e05a41e8 {{(pid=70869) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 15:47:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:22 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:47:22 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:47:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:22 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Deleted allocations for instance bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f
Jul 25 15:47:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ef71890f-4f16-4785-863e-905e1bcefe6d tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.244s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Detaching volume aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4
Jul 25 15:47:25 user nova-compute[70869]: INFO nova.virt.block_device [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Attempting to driver detach volume aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 from mountpoint /dev/vdc
Jul 25 15:47:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Attempting to detach device vdc from instance bba84347-9d28-4789-8d45-3e39770c8f4f from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:47:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:47:25 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:47:25 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:47:25 user nova-compute[70869]:   <target dev="vdc" bus="virtio"/>
Jul 25 15:47:25 user nova-compute[70869]:   <serial>aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4</serial>
Jul 25 15:47:25 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 15:47:25 user nova-compute[70869]: </disk>
Jul 25 15:47:25 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:47:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully detached device vdc from instance bba84347-9d28-4789-8d45-3e39770c8f4f from the persistent domain config.
Jul 25 15:47:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bba84347-9d28-4789-8d45-3e39770c8f4f from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:47:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:47:25 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:47:25 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:47:25 user nova-compute[70869]:   <target dev="vdc" bus="virtio"/>
Jul 25 15:47:25 user nova-compute[70869]:   <serial>aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4</serial>
Jul 25 15:47:25 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 25 15:47:25 user nova-compute[70869]: </disk>
Jul 25 15:47:25 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300046.1003182, bba84347-9d28-4789-8d45-3e39770c8f4f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:47:26 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully detached device vdc from instance bba84347-9d28-4789-8d45-3e39770c8f4f from the live domain config.
Jul 25 15:47:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdzPjJrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:47:26 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6dc569-ff6d-43a1-8d60-4ac418b290f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:47:26 user nova-compute[70869]: No targets found.
Jul 25 15:47:26 user nova-compute[70869]: iSNS:
Jul 25 15:47:26 user nova-compute[70869]: No targets found.
Jul 25 15:47:26 user nova-compute[70869]: STATIC:
Jul 25 15:47:26 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:47:26 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:26 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:26 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4
Jul 25 15:47:26 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:26 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:26 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:47:26 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:47:26 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:47:26 user nova-compute[70869]: FIRMWARE:
Jul 25 15:47:26 user nova-compute[70869]: No targets found.
Jul 25 15:47:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:47:26 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:47:26 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b66ca6-3c26-4953-a432-8f8c25078785]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[381bcdfb-f66e-42a6-91cf-b548ba8afbe5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:26 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:26 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:47:26 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:47:26 user nova-compute[70869]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 (non-flash)
Jul 25 15:47:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43411a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f747a0b-b9d3-44fb-a6ce-09886d5d71b5]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a2e09f-e803-48b6-9cb1-4cbf13c1a9ad]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b6d31c-779e-4421-8e07-ebfbc427993d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d412da1-181a-4c40-a3fa-e82ad3a3d3b7]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5eb7aa-b6a4-4edb-a3cb-4d6ce33d5b81]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdb79ee-7166-4a8f-be7a-c7eafe3ee448]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4, portal: 172.16.0.220,3260]
Jul 25 15:47:26 user nova-compute[70869]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4, portal: 172.16.0.220,3260] successful.
Jul 25 15:47:26 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa763c5b-e6de-4f8f-b0d9-7955b7cc4ba4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4f8677-7770-4a6e-9791-eba21e93746a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] <== disconnect_volume: return (319ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:47:26 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:47:27 user nova-compute[70869]: DEBUG nova.objects.instance [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'flavor' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:47:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8e4a907e-325b-4a16-bca9-3a4264360786 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.008s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:34 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300039.212072, bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:47:34 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] VM Stopped (Lifecycle Event)
Jul 25 15:47:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8987dc94-aa3d-4910-a2e8-8462c7c9a196 None None] [instance: bdbde16d-b5ba-4b39-8f49-9c1dc5785b3f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:47:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:36 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:37 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:47:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:47:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:47:37 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:47:38 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating instance_info_cache with network_info: [{"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:47:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:47:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:47:38 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:38 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances with incomplete migration  {{(pid=70869) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 15:47:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:39 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:47:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:47:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:47:43 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:47:43 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7321MB free_disk=25.147071838378906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 58e838f4-a6e4-4292-a14a-f1e5894c615b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a7211b55-7b3f-455b-b185-4e6432faf006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bba84347-9d28-4789-8d45-3e39770c8f4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bfa66e15-724c-4192-b860-5a221b9c0ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing inventories for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating ProviderTree inventory for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing aggregate associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, aggregates: None {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing trait associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41 {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:47:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:45 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:45 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:45 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:45 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:45 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:47:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 15:47:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] There are 0 instances to clean {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 15:47:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:47:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:47:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG nova.objects.instance [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:05 user nova-compute[70869]: INFO nova.compute.manager [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attaching volume 7ee18582-f42a-41e9-af92-9a3f93829eb5 to /dev/vdb
Jul 25 15:48:05 user nova-compute[70869]: DEBUG os_brick.utils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3443e011-0338-433c-8af2-c82b965945f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[785718d4-3771-4682-8594-30b99df91746]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a802ccbb-4d1c-4bf0-9a76-9c6c62fe2469]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6719086f-2021-44c2-b118-b7c862171a54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:48:05 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:48:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[76829dc1-4cfb-41cf-a6d4-32b2f7ff46ac]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG os_brick.utils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:05 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating existing volume attachment record: 2f5c07a4-4490-4df0-a855-f398a8429301 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:48:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-25ba7fcb-426a-4e33-88a7-de744ffacda6 req-6c0c6cf0-b46a-497f-bf78-7a712c92ce4f service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received event network-changed-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-25ba7fcb-426a-4e33-88a7-de744ffacda6 req-6c0c6cf0-b46a-497f-bf78-7a712c92ce4f service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Refreshing instance network info cache due to event network-changed-4d5dfc99-2612-4f21-96c1-dd195692db33. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:48:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-25ba7fcb-426a-4e33-88a7-de744ffacda6 req-6c0c6cf0-b46a-497f-bf78-7a712c92ce4f service nova] Acquiring lock "refresh_cache-bfa66e15-724c-4192-b860-5a221b9c0ba3" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:48:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-25ba7fcb-426a-4e33-88a7-de744ffacda6 req-6c0c6cf0-b46a-497f-bf78-7a712c92ce4f service nova] Acquired lock "refresh_cache-bfa66e15-724c-4192-b860-5a221b9c0ba3" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:48:11 user nova-compute[70869]: DEBUG nova.network.neutron [req-25ba7fcb-426a-4e33-88a7-de744ffacda6 req-6c0c6cf0-b46a-497f-bf78-7a712c92ce4f service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Refreshing network info cache for port 4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:48:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-25ba7fcb-426a-4e33-88a7-de744ffacda6 req-6c0c6cf0-b46a-497f-bf78-7a712c92ce4f service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Updated VIF entry in instance network info cache for port 4d5dfc99-2612-4f21-96c1-dd195692db33. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:48:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-25ba7fcb-426a-4e33-88a7-de744ffacda6 req-6c0c6cf0-b46a-497f-bf78-7a712c92ce4f service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Updating instance_info_cache with network_info: [{"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:48:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-25ba7fcb-426a-4e33-88a7-de744ffacda6 req-6c0c6cf0-b46a-497f-bf78-7a712c92ce4f service nova] Releasing lock "refresh_cache-bfa66e15-724c-4192-b860-5a221b9c0ba3" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:48:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG nova.objects.instance [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:14 user nova-compute[70869]: INFO nova.compute.manager [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Attaching volume 33aaef0f-a8d3-4366-b726-296b954ada76 to /dev/vdb
Jul 25 15:48:14 user nova-compute[70869]: DEBUG os_brick.utils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2219bfd7-e16e-4f60-a073-b1b7e7f47142]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2cd7f6-6057-491e-8dd0-a9fdca07ee8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca34d217-814f-4fe9-8a97-0fa30df2dae9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[186c1b20-46f3-4af4-a3e3-a3708b1d75c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:48:14 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:48:14 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e8b40a-60b6-43f0-8f70-1b0b31e65de0]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG os_brick.utils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:14 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Updating existing volume attachment record: 1afeadbd-a2c3-4015-af6f-06d619c22489 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:48:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:15 user nova-compute[70869]: INFO nova.compute.manager [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Terminating instance
Jul 25 15:48:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:48:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-4ddffaf7-9070-474c-8ce5-81ce404a5735 req-638b30df-7e74-4f30-81cc-472cd853268a service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-unplugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4ddffaf7-9070-474c-8ce5-81ce404a5735 req-638b30df-7e74-4f30-81cc-472cd853268a service nova] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4ddffaf7-9070-474c-8ce5-81ce404a5735 req-638b30df-7e74-4f30-81cc-472cd853268a service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4ddffaf7-9070-474c-8ce5-81ce404a5735 req-638b30df-7e74-4f30-81cc-472cd853268a service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-4ddffaf7-9070-474c-8ce5-81ce404a5735 req-638b30df-7e74-4f30-81cc-472cd853268a service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] No waiting events found dispatching network-vif-unplugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-4ddffaf7-9070-474c-8ce5-81ce404a5735 req-638b30df-7e74-4f30-81cc-472cd853268a service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-unplugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKNzUnHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:16 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:16 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:16 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1d1cf4-1c6e-4e2f-8b14-0c302860dbc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:48:16 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7b3ef5-d071-4d41-b3ac-33970a0f4a04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5] added
Jul 25 15:48:16 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[173d7c35-abee-4abc-9669-b5b917961cad]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[162ffa0a-41fa-4d4d-b760-759beaba95ce]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKNzUnHi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKNzUnHi" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec880db7-c95c-475d-b22e-0cee55293b53]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sKNzUnHi'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b77873-3b5c-448e-97ff-362d4c71d019]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[77202fd1-403d-41fa-82fa-ba5065587932]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:16 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:16 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:16 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:16 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d59563-0d68-440f-a88e-28398dab1bb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5, portal: 172.16.0.220,3260]
Jul 25 15:48:16 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5, portal: 172.16.0.220,3260] successful.
Jul 25 15:48:16 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[960a18a7-3803-4bba-8a7c-b92db51c9e40]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b675fb6c-174e-47d5-bfa4-ee0a34e5ee65]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:16 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:16 user nova-compute[70869]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 (non-flash)
Jul 25 15:48:16 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:16 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:16 user nova-compute[70869]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 (non-flash)
Jul 25 15:48:16 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[351711c7-b43d-4be6-be98-6fc2a088f981]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKNzUnHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:48:16 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Instance destroyed successfully.
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'resources' on Instance uuid bba84347-9d28-4789-8d45-3e39770c8f4f {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2130419921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2130419921',id=27,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBibbEANFpipugLVFSsyYgF7Xx6RRXls3oAwTaoxYPberG6kOOsbNUG8bY+SxGCe3UQ/4Me+ZJgD39OBGA19dXjFi/9teyY6MK62PbcwCIEvg5E2zAdMNXFkGMs5GUse8Q==',key_name='tempest-keypair-529975062',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-qvjhymog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:45:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=bba84347-9d28-4789-8d45-3e39770c8f4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "address": "fa:16:3e:37:40:c9", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8120e3-6f", "ovs_interfaceid": "dc8120e3-6fb4-438a-94a3-7cbb36406ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG os_vif [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc8120e3-6f, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:48:16 user nova-compute[70869]: INFO os_vif [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:40:c9,bridge_name='br-int',has_traffic_filtering=True,id=dc8120e3-6fb4-438a-94a3-7cbb36406ebd,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8120e3-6f')
Jul 25 15:48:16 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Deleting instance files /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f_del
Jul 25 15:48:16 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Deletion of /opt/stack/data/nova/instances/bba84347-9d28-4789-8d45-3e39770c8f4f_del complete
Jul 25 15:48:16 user nova-compute[70869]: INFO nova.compute.manager [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 25 15:48:16 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:48:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23233623131353432', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233623131353432', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG nova.objects.instance [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:48:17 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:48:17 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:48:17 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:48:17 user nova-compute[70869]:   <serial>7ee18582-f42a-41e9-af92-9a3f93829eb5</serial>
Jul 25 15:48:17 user nova-compute[70869]: </disk>
Jul 25 15:48:17 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:17 user nova-compute[70869]: INFO nova.compute.manager [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Terminating instance
Jul 25 15:48:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:17 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Took 1.09 seconds to deallocate network for instance.
Jul 25 15:48:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-069ce738-3309-4a92-9a3c-5c43a5b13417 req-6821ba35-27ba-4d77-bdc3-8e203c61d456 service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-deleted-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No VIF found with MAC fa:16:3e:10:17:8d, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-3e9d285a-0a67-4bf8-ba4d-74d657398196 req-3fe68e6d-7eeb-44e1-b05d-9e31fc53c894 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-unplugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3e9d285a-0a67-4bf8-ba4d-74d657398196 req-3fe68e6d-7eeb-44e1-b05d-9e31fc53c894 service nova] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3e9d285a-0a67-4bf8-ba4d-74d657398196 req-3fe68e6d-7eeb-44e1-b05d-9e31fc53c894 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3e9d285a-0a67-4bf8-ba4d-74d657398196 req-3fe68e6d-7eeb-44e1-b05d-9e31fc53c894 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-3e9d285a-0a67-4bf8-ba4d-74d657398196 req-3fe68e6d-7eeb-44e1-b05d-9e31fc53c894 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] No waiting events found dispatching network-vif-unplugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-3e9d285a-0a67-4bf8-ba4d-74d657398196 req-3fe68e6d-7eeb-44e1-b05d-9e31fc53c894 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-unplugged-b7d31348-a01c-40f7-993c-e350d788f767 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-eaed034b-bd52-4a69-82a3-4af16563b836 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.668s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:18 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Deleted allocations for instance bba84347-9d28-4789-8d45-3e39770c8f4f
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b1bff1a7-f999-4ecd-9d8d-1f3fc1942d79 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Instance destroyed successfully.
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.objects.instance [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lazy-loading 'resources' on Instance uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905910393',display_name='tempest-ServerActionsTestOtherA-server-711537279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905910393',id=5,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMBmEl2aHhgzzUBApvdX0/Bj/1/YJNHjJjQhVKPThUELe5uafebF/DlVzdbYpgO1AZwUhnQRMqvIusRr8LmAw5lpJ7j/40bN59gNJ0sT4eqvdLTA12nkEuOJ43br5J90Q==',key_name='tempest-keypair-2034763603',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f52ab59c5e0a442aa53ad1edd6b4ec5e',ramdisk_id='',reservation_id='r-on5sl0lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-798279085',owner_user_name='tempest-ServerActionsTestOtherA-798279085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d09efb7dac2429a97ec41381705c5a5',uuid=bf86a3b2-1ba1-490d-aef7-cbd7f17693c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converting VIF {"id": "b7d31348-a01c-40f7-993c-e350d788f767", "address": "fa:16:3e:51:e8:f2", "network": {"id": "59c05ded-53c8-4969-b78b-c44a5ba512d5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-183118264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f52ab59c5e0a442aa53ad1edd6b4ec5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d31348-a0", "ovs_interfaceid": "b7d31348-a01c-40f7-993c-e350d788f767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG os_vif [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7d31348-a0, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:48:18 user nova-compute[70869]: INFO os_vif [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:e8:f2,bridge_name='br-int',has_traffic_filtering=True,id=b7d31348-a01c-40f7-993c-e350d788f767,network=Network(59c05ded-53c8-4969-b78b-c44a5ba512d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d31348-a0')
Jul 25 15:48:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Deleting instance files /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1_del
Jul 25 15:48:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Deletion of /opt/stack/data/nova/instances/bf86a3b2-1ba1-490d-aef7-cbd7f17693c1_del complete
Jul 25 15:48:18 user nova-compute[70869]: INFO nova.compute.manager [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-908a1750-4f2a-4a81-89ee-af9a75916ee0 req-5fd52db2-5ba9-42d5-85ea-ecb03a3741da service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-908a1750-4f2a-4a81-89ee-af9a75916ee0 req-5fd52db2-5ba9-42d5-85ea-ecb03a3741da service nova] Acquiring lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-908a1750-4f2a-4a81-89ee-af9a75916ee0 req-5fd52db2-5ba9-42d5-85ea-ecb03a3741da service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-908a1750-4f2a-4a81-89ee-af9a75916ee0 req-5fd52db2-5ba9-42d5-85ea-ecb03a3741da service nova] Lock "bba84347-9d28-4789-8d45-3e39770c8f4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-908a1750-4f2a-4a81-89ee-af9a75916ee0 req-5fd52db2-5ba9-42d5-85ea-ecb03a3741da service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] No waiting events found dispatching network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:48:18 user nova-compute[70869]: WARNING nova.compute.manager [req-908a1750-4f2a-4a81-89ee-af9a75916ee0 req-5fd52db2-5ba9-42d5-85ea-ecb03a3741da service nova] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Received unexpected event network-vif-plugged-dc8120e3-6fb4-438a-94a3-7cbb36406ebd for instance with vm_state deleted and task_state None.
Jul 25 15:48:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:48:19 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Took 0.58 seconds to deallocate network for instance.
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_power_states {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:19 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Deleted allocations for instance bf86a3b2-1ba1-490d-aef7-cbd7f17693c1
Jul 25 15:48:19 user nova-compute[70869]: WARNING nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 5ce85315-be2f-4be3-953f-ed7b5d4685d6 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 18fc35fb-1ce7-4744-9189-1d80ede0a230 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid fc8f7a35-cb25-469d-ba79-832b8e6aaba0 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "18fc35fb-1ce7-4744-9189-1d80ede0a230" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de39f485-e127-4c30-b512-f59574352109 tempest-ServerActionsTestOtherA-798279085 tempest-ServerActionsTestOtherA-798279085-project-member] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.160s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.091s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:19 user nova-compute[70869]: DEBUG nova.compute.manager [req-8a02dc1d-210e-4adc-b1af-d807f2f83f06 req-f24401ca-dff5-454f-ab8c-cb048ac8fa74 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-deleted-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:20 user nova-compute[70869]: INFO nova.compute.manager [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Detaching volume 7ee18582-f42a-41e9-af92-9a3f93829eb5
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-2b02d6f5-580d-43d8-858d-ebb5119ba0e5 req-866e1d67-8d6b-493b-97f0-26c4b809e2b0 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b02d6f5-580d-43d8-858d-ebb5119ba0e5 req-866e1d67-8d6b-493b-97f0-26c4b809e2b0 service nova] Acquiring lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b02d6f5-580d-43d8-858d-ebb5119ba0e5 req-866e1d67-8d6b-493b-97f0-26c4b809e2b0 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b02d6f5-580d-43d8-858d-ebb5119ba0e5 req-866e1d67-8d6b-493b-97f0-26c4b809e2b0 service nova] Lock "bf86a3b2-1ba1-490d-aef7-cbd7f17693c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-2b02d6f5-580d-43d8-858d-ebb5119ba0e5 req-866e1d67-8d6b-493b-97f0-26c4b809e2b0 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] No waiting events found dispatching network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:48:20 user nova-compute[70869]: WARNING nova.compute.manager [req-2b02d6f5-580d-43d8-858d-ebb5119ba0e5 req-866e1d67-8d6b-493b-97f0-26c4b809e2b0 service nova] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Received unexpected event network-vif-plugged-b7d31348-a01c-40f7-993c-e350d788f767 for instance with vm_state deleted and task_state None.
Jul 25 15:48:20 user nova-compute[70869]: INFO nova.virt.block_device [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attempting to driver detach volume 7ee18582-f42a-41e9-af92-9a3f93829eb5 from mountpoint /dev/vdb
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Attempting to detach device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:48:20 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:48:20 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:48:20 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:48:20 user nova-compute[70869]:   <serial>7ee18582-f42a-41e9-af92-9a3f93829eb5</serial>
Jul 25 15:48:20 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:48:20 user nova-compute[70869]: </disk>
Jul 25 15:48:20 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:48:20 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully detached device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the persistent domain config.
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:48:20 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:48:20 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:48:20 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:48:20 user nova-compute[70869]:   <serial>7ee18582-f42a-41e9-af92-9a3f93829eb5</serial>
Jul 25 15:48:20 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:48:20 user nova-compute[70869]: </disk>
Jul 25 15:48:20 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300100.6416922, a7211b55-7b3f-455b-b185-4e6432faf006 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:48:20 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully detached device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the live domain config.
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKNzUnHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:20 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb66a99-caf8-4f9b-b254-41a3fac29ec5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:48:20 user nova-compute[70869]: No targets found.
Jul 25 15:48:20 user nova-compute[70869]: iSNS:
Jul 25 15:48:20 user nova-compute[70869]: No targets found.
Jul 25 15:48:20 user nova-compute[70869]: STATIC:
Jul 25 15:48:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:48:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:48:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:20 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5
Jul 25 15:48:20 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:20 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:20 user nova-compute[70869]: FIRMWARE:
Jul 25 15:48:20 user nova-compute[70869]: No targets found.
Jul 25 15:48:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:48:20 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:48:20 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6035f3da-1939-4b2d-b955-d49c7a63be8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd64943c-f5f6-42cb-a50b-6a9009c06815]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:20 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:20 user nova-compute[70869]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 (non-flash)
Jul 25 15:48:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:20 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:20 user nova-compute[70869]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 (non-flash)
Jul 25 15:48:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe41c5e7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4479c089-8c88-46fd-a179-c8efbe942a45]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce3c4bd-3345-4ccc-85fd-883ed5df7ea9]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0e1199-0db8-4eae-888e-40adf05e176b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5c802f-0b44-4a4c-84d3-921a2a8ad896]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[156f6780-61ca-4c6c-a1e8-4edb5ec2e687]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2e614e-43b6-4b50-bc44-9a22c8111446]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5, portal: 172.16.0.220,3260]
Jul 25 15:48:20 user nova-compute[70869]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5, portal: 172.16.0.220,3260] successful.
Jul 25 15:48:20 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee18582-f42a-41e9-af92-9a3f93829eb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f971d48c-7244-406a-9407-9fac41cf244e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== disconnect_volume: return (326ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:48:21 user nova-compute[70869]: DEBUG nova.objects.instance [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-18856b3b-2e19-4997-9048-aeba05743314 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:48:21 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSdnJKfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:21 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:21 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:21 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:21 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:21 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:21 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:21 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:48:21 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[824365db-6f0a-4851-8754-9c4c6ca44ff9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:48:22 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d9fa80-4b1e-4158-9652-83324de05fe0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76] added
Jul 25 15:48:22 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de55449-fff3-4bd9-a366-e2f77190f476]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0ad500-a79a-4692-b839-0a4f511166ab]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSdnJKfP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSdnJKfP" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca8fa13-b3f3-432a-a6de-995032ad4507]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSdnJKfP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[af068858-ab66-4e17-9f1d-55f1095771d1]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[47342104-181d-4dea-b5ff-8a403dc5763b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:22 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:22 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:22 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:22 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[29407a77-dd6b-496f-becd-9d5ec76e1e26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76, portal: 172.16.0.220,3260]
Jul 25 15:48:22 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76, portal: 172.16.0.220,3260] successful.
Jul 25 15:48:22 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[62920ba7-1ac0-40a8-a3f5-49c9b3c86a9e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f585070a-4626-4b7c-8eef-33b849a43c2a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:22 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:22 user nova-compute[70869]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)
Jul 25 15:48:22 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:22 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:22 user nova-compute[70869]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)
Jul 25 15:48:22 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[682713c7-830d-4ac9-bc5b-e55a87e8d950]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:22 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSdnJKfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26432323834626664', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432323834626664', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG nova.objects.instance [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:48:23 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:48:23 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:48:23 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:48:23 user nova-compute[70869]:   <serial>33aaef0f-a8d3-4366-b726-296b954ada76</serial>
Jul 25 15:48:23 user nova-compute[70869]: </disk>
Jul 25 15:48:23 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No VIF found with MAC fa:16:3e:3f:1c:5b, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-17553fb8-1d86-4f56-8279-c814e151dbde tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.183s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.066s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:27 user nova-compute[70869]: INFO nova.compute.manager [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Attaching volume 4aea0f27-737d-4e08-a8fa-53694fb236e6 to /dev/vdc
Jul 25 15:48:27 user nova-compute[70869]: DEBUG os_brick.utils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6f7e13-8561-4f61-b2f0-954c269b8fbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[204ef003-0359-4fe2-814c-db86d70c2fcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c0e38d-cfa6-40e0-ac9a-6294d891a097]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd28a39-ea10-40cf-a522-bf451b5c856e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:48:27 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:48:27 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb2bc37-90af-4702-8a2a-c2ab6f006608]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG os_brick.utils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:27 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Updating existing volume attachment record: 72b36971-b4b9-4352-900b-7846e09fcffe {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:48:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:31 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300096.6244185, bba84347-9d28-4789-8d45-3e39770c8f4f => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:48:31 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] VM Stopped (Lifecycle Event)
Jul 25 15:48:31 user nova-compute[70869]: DEBUG nova.compute.manager [None req-31a07dcc-6de7-4fd0-ac60-634b23235bbc None None] [instance: bba84347-9d28-4789-8d45-3e39770c8f4f] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:48:33 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300098.5527053, bf86a3b2-1ba1-490d-aef7-cbd7f17693c1 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:48:33 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] VM Stopped (Lifecycle Event)
Jul 25 15:48:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-efb75232-d2e3-4779-b084-0b6d6b68e298 None None] [instance: bf86a3b2-1ba1-490d-aef7-cbd7f17693c1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:48:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MScqxhPg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:34 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:34 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:34 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d7af5-159f-4d6f-a0b0-5b08ad34405c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:48:34 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df7c796-3253-48a0-b446-d1d6814a1d0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6] added
Jul 25 15:48:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ffd5e6-9b6d-49d8-9ac9-dc64d5667c9f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94d5c91-1e01-4722-8e49-63f1723f08ca]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MScqxhPg {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MScqxhPg" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3cbec6-a2bb-4710-81db-3705fd9a56ec]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MScqxhPg'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2dcb47-ca24-45cf-8d2a-97921aaadf23]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6926f5b-9394-4832-8250-d70eba449815]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb33fd7d-c6ce-49b7-9fbb-c4ee6e07843a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6, portal: 172.16.0.220,3260]
Jul 25 15:48:34 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6, portal: 172.16.0.220,3260] successful.
Jul 25 15:48:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[91533c36-47d0-43c1-81a9-86498a9a63e1]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[190e5f90-41cd-4f8e-849e-3200cc93074d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 (non-flash)
Jul 25 15:48:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[768c46b5-47a2-4aba-ab4e-43f1c3649605]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:34 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MScqxhPg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23633613432353738', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633613432353738', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:48:35 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:48:35 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:48:35 user nova-compute[70869]:   <target dev="vdc" bus="virtio"/>
Jul 25 15:48:35 user nova-compute[70869]:   <serial>4aea0f27-737d-4e08-a8fa-53694fb236e6</serial>
Jul 25 15:48:35 user nova-compute[70869]: </disk>
Jul 25 15:48:35 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] No VIF found with MAC fa:16:3e:3f:1c:5b, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:48:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4ccf5f20-f1a0-4ea5-bf89-d8f92cf596a8 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.679s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:37 user nova-compute[70869]: INFO nova.compute.manager [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Detaching volume 33aaef0f-a8d3-4366-b726-296b954ada76
Jul 25 15:48:37 user nova-compute[70869]: INFO nova.virt.block_device [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Attempting to driver detach volume 33aaef0f-a8d3-4366-b726-296b954ada76 from mountpoint /dev/vdb
Jul 25 15:48:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Attempting to detach device vdb from instance bfa66e15-724c-4192-b860-5a221b9c0ba3 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:48:37 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:48:37 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:48:37 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:48:37 user nova-compute[70869]:   <serial>33aaef0f-a8d3-4366-b726-296b954ada76</serial>
Jul 25 15:48:37 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:48:37 user nova-compute[70869]: </disk>
Jul 25 15:48:37 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:48:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully detached device vdb from instance bfa66e15-724c-4192-b860-5a221b9c0ba3 from the persistent domain config.
Jul 25 15:48:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bfa66e15-724c-4192-b860-5a221b9c0ba3 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:48:37 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:48:37 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:48:37 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:48:37 user nova-compute[70869]:   <serial>33aaef0f-a8d3-4366-b726-296b954ada76</serial>
Jul 25 15:48:37 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:48:37 user nova-compute[70869]: </disk>
Jul 25 15:48:37 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300117.8471906, bfa66e15-724c-4192-b860-5a221b9c0ba3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:48:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully detached device vdb from instance bfa66e15-724c-4192-b860-5a221b9c0ba3 from the live domain config.
Jul 25 15:48:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSdnJKfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:37 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6eb003-4391-49c8-a2a4-fffa2b131ba6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:48:37 user nova-compute[70869]: No targets found.
Jul 25 15:48:37 user nova-compute[70869]: iSNS:
Jul 25 15:48:37 user nova-compute[70869]: No targets found.
Jul 25 15:48:37 user nova-compute[70869]: STATIC:
Jul 25 15:48:37 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:48:37 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:37 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:37 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76
Jul 25 15:48:37 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:37 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:37 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6
Jul 25 15:48:37 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:37 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:37 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:48:37 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:37 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:37 user nova-compute[70869]: FIRMWARE:
Jul 25 15:48:37 user nova-compute[70869]: No targets found.
Jul 25 15:48:37 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:48:37 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:48:37 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[84324c61-de0c-4473-a106-d591e1a3b826]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5616645d-446f-430c-97df-00abffedd15b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:37 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:37 user nova-compute[70869]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)
Jul 25 15:48:37 user nova-compute[70869]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 (non-flash)
Jul 25 15:48:37 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:37 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:37 user nova-compute[70869]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 (non-flash)
Jul 25 15:48:37 user nova-compute[70869]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 (non-flash)
Jul 25 15:48:37 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c1de440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96457b2-af00-4b99-bfda-8f12e1f3f7f9]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[904962c5-3765-4e15-ab6b-a1044f61327b]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d5678f-2331-49ac-bcb2-2d1f025968ff]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:37 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[23743831-8f58-4ca6-9b08-f7685c207aeb]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c8c62b-3ab7-4e3c-81e1-4cbf39672420]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[47186e1e-55b1-4bb3-ad28-8aedbfbe1f52]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76, portal: 172.16.0.220,3260]
Jul 25 15:48:38 user nova-compute[70869]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76, portal: 172.16.0.220,3260] successful.
Jul 25 15:48:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33aaef0f-a8d3-4366-b726-296b954ada76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c9d6d-2db0-4492-8021-100b79cc4951]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== disconnect_volume: return (302ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG nova.objects.instance [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c6da430b-28a4-4ef8-afa6-bb388762a7e0 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:48:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:39 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updating instance_info_cache with network_info: [{"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:48:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-a525e472-1e7b-40b5-a4b1-5ba8bae313c9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:48:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:48:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:39 user nova-compute[70869]: INFO nova.compute.manager [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Detaching volume 4aea0f27-737d-4e08-a8fa-53694fb236e6
Jul 25 15:48:39 user nova-compute[70869]: INFO nova.virt.block_device [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Attempting to driver detach volume 4aea0f27-737d-4e08-a8fa-53694fb236e6 from mountpoint /dev/vdc
Jul 25 15:48:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Attempting to detach device vdc from instance bfa66e15-724c-4192-b860-5a221b9c0ba3 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:48:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:48:39 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:48:39 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:48:39 user nova-compute[70869]:   <target dev="vdc" bus="virtio"/>
Jul 25 15:48:39 user nova-compute[70869]:   <serial>4aea0f27-737d-4e08-a8fa-53694fb236e6</serial>
Jul 25 15:48:39 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 15:48:39 user nova-compute[70869]: </disk>
Jul 25 15:48:39 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:48:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully detached device vdc from instance bfa66e15-724c-4192-b860-5a221b9c0ba3 from the persistent domain config.
Jul 25 15:48:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bfa66e15-724c-4192-b860-5a221b9c0ba3 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:48:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:48:39 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:48:39 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:48:39 user nova-compute[70869]:   <target dev="vdc" bus="virtio"/>
Jul 25 15:48:39 user nova-compute[70869]:   <serial>4aea0f27-737d-4e08-a8fa-53694fb236e6</serial>
Jul 25 15:48:39 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 25 15:48:39 user nova-compute[70869]: </disk>
Jul 25 15:48:39 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300120.1988337, bfa66e15-724c-4192-b860-5a221b9c0ba3 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:48:40 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully detached device vdc from instance bfa66e15-724c-4192-b860-5a221b9c0ba3 from the live domain config.
Jul 25 15:48:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MScqxhPg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:40 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3badf26-39cf-411e-ba65-467180ce3a29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:48:40 user nova-compute[70869]: No targets found.
Jul 25 15:48:40 user nova-compute[70869]: iSNS:
Jul 25 15:48:40 user nova-compute[70869]: No targets found.
Jul 25 15:48:40 user nova-compute[70869]: STATIC:
Jul 25 15:48:40 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:48:40 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:40 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:40 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6
Jul 25 15:48:40 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:40 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:40 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:48:40 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:40 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:40 user nova-compute[70869]: FIRMWARE:
Jul 25 15:48:40 user nova-compute[70869]: No targets found.
Jul 25 15:48:40 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:48:40 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:48:40 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3288125-3b94-4dbb-92f3-9baa0ca65fe1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b3ee30-d4bf-40ec-94e7-48af9698d70d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:40 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:40 user nova-compute[70869]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 (non-flash)
Jul 25 15:48:40 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:40 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:40 user nova-compute[70869]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 (non-flash)
Jul 25 15:48:40 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43411b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f919c95d-ef30-4044-ae86-18b82eade87d]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[42459293-bace-456e-87e6-f7a2c1158e5d]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[db48c811-91c2-423d-adfe-1361d678b941]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e42258-9ba7-45c7-b3f4-fb31882055a9]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c4556-acf8-47f9-bcc1-b80144ea01df]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea50dd74-3a64-4975-a6ae-b2e2f58a2694]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6, portal: 172.16.0.220,3260]
Jul 25 15:48:40 user nova-compute[70869]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6, portal: 172.16.0.220,3260] successful.
Jul 25 15:48:40 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aea0f27-737d-4e08-a8fa-53694fb236e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2750f62c-1ce0-40f1-9770-1ede1845ba10]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] <== disconnect_volume: return (299ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:48:40 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:41 user nova-compute[70869]: DEBUG nova.objects.instance [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'flavor' on Instance uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-72f56ee1-1601-4649-9624-faf85320f239 tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:48:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:42 user nova-compute[70869]: INFO nova.compute.manager [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Terminating instance
Jul 25 15:48:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-1624c951-116b-4176-b786-03353262c44d req-6de73bb4-f054-4fce-8b0d-4209b84ce454 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received event network-vif-unplugged-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1624c951-116b-4176-b786-03353262c44d req-6de73bb4-f054-4fce-8b0d-4209b84ce454 service nova] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1624c951-116b-4176-b786-03353262c44d req-6de73bb4-f054-4fce-8b0d-4209b84ce454 service nova] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1624c951-116b-4176-b786-03353262c44d req-6de73bb4-f054-4fce-8b0d-4209b84ce454 service nova] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-1624c951-116b-4176-b786-03353262c44d req-6de73bb4-f054-4fce-8b0d-4209b84ce454 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] No waiting events found dispatching network-vif-unplugged-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-1624c951-116b-4176-b786-03353262c44d req-6de73bb4-f054-4fce-8b0d-4209b84ce454 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received event network-vif-unplugged-4d5dfc99-2612-4f21-96c1-dd195692db33 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Instance destroyed successfully.
Jul 25 15:48:43 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lazy-loading 'resources' on Instance uuid bfa66e15-724c-4192-b860-5a221b9c0ba3 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-603986360',display_name='tempest-AttachVolumeTestJSON-server-603986360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-603986360',id=30,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO5oqqa0gFlqswHtc2eA/xRjuuMvUDSBXadrNXwp6YDCGf+ztaeALe5wOWNRDZF8cyblr/POnOOBGtg5/pmho5dUYPfMhnUHAGzSkHJldKFSsfaYBM65z2GaQ2BZm8Z9w==',key_name='tempest-keypair-2111458639',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2f5d520a39742c69302f96795d0ea61',ramdisk_id='',reservation_id='r-9kxxasi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-512738646',owner_user_name='tempest-AttachVolumeTestJSON-512738646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d528e01a08f40d4b598ab8222c2edf5',uuid=bfa66e15-724c-4192-b860-5a221b9c0ba3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converting VIF {"id": "4d5dfc99-2612-4f21-96c1-dd195692db33", "address": "fa:16:3e:3f:1c:5b", "network": {"id": "3df67b4f-4832-4c5b-926d-235acf37f651", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-783233339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2f5d520a39742c69302f96795d0ea61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5dfc99-26", "ovs_interfaceid": "4d5dfc99-2612-4f21-96c1-dd195692db33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=4d5dfc99-2612-4f21-96c1-dd195692db33,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5dfc99-26') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG os_vif [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=4d5dfc99-2612-4f21-96c1-dd195692db33,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5dfc99-26') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d5dfc99-26, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:48:43 user nova-compute[70869]: INFO os_vif [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=4d5dfc99-2612-4f21-96c1-dd195692db33,network=Network(3df67b4f-4832-4c5b-926d-235acf37f651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5dfc99-26')
Jul 25 15:48:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Deleting instance files /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3_del
Jul 25 15:48:43 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Deletion of /opt/stack/data/nova/instances/bfa66e15-724c-4192-b860-5a221b9c0ba3_del complete
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:43 user nova-compute[70869]: INFO nova.compute.manager [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-67f4f342-81da-4e98-8557-74410ff39a91 req-518c0cc4-78c4-4886-886d-11302aa4b301 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received event network-vif-deleted-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:44 user nova-compute[70869]: INFO nova.compute.manager [req-67f4f342-81da-4e98-8557-74410ff39a91 req-518c0cc4-78c4-4886-886d-11302aa4b301 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Neutron deleted interface 4d5dfc99-2612-4f21-96c1-dd195692db33; detaching it from the instance and deleting it from the info cache
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-67f4f342-81da-4e98-8557-74410ff39a91 req-518c0cc4-78c4-4886-886d-11302aa4b301 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:48:44 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:48:44 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=25.19731903076172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:44 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Took 1.34 seconds to deallocate network for instance.
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-67f4f342-81da-4e98-8557-74410ff39a91 req-518c0cc4-78c4-4886-886d-11302aa4b301 service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Detach interface failed, port_id=4d5dfc99-2612-4f21-96c1-dd195692db33, reason: Instance bfa66e15-724c-4192-b860-5a221b9c0ba3 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 58e838f4-a6e4-4292-a14a-f1e5894c615b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a7211b55-7b3f-455b-b185-4e6432faf006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bfa66e15-724c-4192-b860-5a221b9c0ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-b169e735-10c9-418f-9b97-0b2c3fc3b6d0 req-8dbe1ecb-ca65-4c23-848c-0c939ee8773b service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received event network-vif-plugged-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b169e735-10c9-418f-9b97-0b2c3fc3b6d0 req-8dbe1ecb-ca65-4c23-848c-0c939ee8773b service nova] Acquiring lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b169e735-10c9-418f-9b97-0b2c3fc3b6d0 req-8dbe1ecb-ca65-4c23-848c-0c939ee8773b service nova] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b169e735-10c9-418f-9b97-0b2c3fc3b6d0 req-8dbe1ecb-ca65-4c23-848c-0c939ee8773b service nova] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-b169e735-10c9-418f-9b97-0b2c3fc3b6d0 req-8dbe1ecb-ca65-4c23-848c-0c939ee8773b service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] No waiting events found dispatching network-vif-plugged-4d5dfc99-2612-4f21-96c1-dd195692db33 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:48:44 user nova-compute[70869]: WARNING nova.compute.manager [req-b169e735-10c9-418f-9b97-0b2c3fc3b6d0 req-8dbe1ecb-ca65-4c23-848c-0c939ee8773b service nova] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Received unexpected event network-vif-plugged-4d5dfc99-2612-4f21-96c1-dd195692db33 for instance with vm_state deleted and task_state None.
Jul 25 15:48:45 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:48:45 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:48:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:48:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.415s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:45 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:48:45 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:48:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:45 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Deleted allocations for instance bfa66e15-724c-4192-b860-5a221b9c0ba3
Jul 25 15:48:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b61e53f-51cd-4194-b23d-8db91f1e78fb tempest-AttachVolumeTestJSON-512738646 tempest-AttachVolumeTestJSON-512738646-project-member] Lock "bfa66e15-724c-4192-b860-5a221b9c0ba3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.152s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:48:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:48:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:50 user nova-compute[70869]: INFO nova.compute.manager [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Terminating instance
Jul 25 15:48:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:48:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-0959cc7d-e398-4313-9b30-63d16980162b req-5a77d6d9-186d-40d7-a796-bf6a7d9bd34f service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-unplugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0959cc7d-e398-4313-9b30-63d16980162b req-5a77d6d9-186d-40d7-a796-bf6a7d9bd34f service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0959cc7d-e398-4313-9b30-63d16980162b req-5a77d6d9-186d-40d7-a796-bf6a7d9bd34f service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0959cc7d-e398-4313-9b30-63d16980162b req-5a77d6d9-186d-40d7-a796-bf6a7d9bd34f service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-0959cc7d-e398-4313-9b30-63d16980162b req-5a77d6d9-186d-40d7-a796-bf6a7d9bd34f service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-unplugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-0959cc7d-e398-4313-9b30-63d16980162b req-5a77d6d9-186d-40d7-a796-bf6a7d9bd34f service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-unplugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:48:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Instance destroyed successfully.
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'resources' on Instance uuid 58e838f4-a6e4-4292-a14a-f1e5894c615b {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-641923212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-641923212',id=28,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-6itgyw2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:47:05Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=58e838f4-a6e4-4292-a14a-f1e5894c615b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "8624ca7f-ed89-4043-8c98-806cdf440681", "address": "fa:16:3e:6b:b4:8c", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624ca7f-ed", "ovs_interfaceid": "8624ca7f-ed89-4043-8c98-806cdf440681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b4:8c,bridge_name='br-int',has_traffic_filtering=True,id=8624ca7f-ed89-4043-8c98-806cdf440681,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624ca7f-ed') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_vif [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b4:8c,bridge_name='br-int',has_traffic_filtering=True,id=8624ca7f-ed89-4043-8c98-806cdf440681,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624ca7f-ed') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8624ca7f-ed, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:48:51 user nova-compute[70869]: INFO os_vif [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b4:8c,bridge_name='br-int',has_traffic_filtering=True,id=8624ca7f-ed89-4043-8c98-806cdf440681,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624ca7f-ed')
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbIeNnLG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:48:51 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[001a2ae0-c81b-4c9e-8d52-5b312eb571a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:48:51 user nova-compute[70869]: No targets found.
Jul 25 15:48:51 user nova-compute[70869]: iSNS:
Jul 25 15:48:51 user nova-compute[70869]: No targets found.
Jul 25 15:48:51 user nova-compute[70869]: STATIC:
Jul 25 15:48:51 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988
Jul 25 15:48:51 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:51 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:51 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:48:51 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:48:51 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:48:51 user nova-compute[70869]: FIRMWARE:
Jul 25 15:48:51 user nova-compute[70869]: No targets found.
Jul 25 15:48:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:48:51 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:48:51 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f69e1e0-6d56-4ed0-974f-0e1c36370bb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b6f6d7-efb7-45e8-b203-e37857109789]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:51 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:48:51 user nova-compute[70869]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 (non-flash)
Jul 25 15:48:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4342bc4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988'): ({'sdg'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Removing single pathed devices sdg {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9dedca-05c6-4ddc-8a9e-6e2caa822dfc]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33d885-66ce-4ad9-9829-4c05f112e637]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flushing IO for device /dev/sdg {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b7e6e2-04ab-4b92-ae98-89b6cfbab6da]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[59545fb6-353a-480c-b893-973161104997]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] SCSI volumes sdg have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23934336436376633', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5806e7c6', '/dev/disk/by-id/scsi-1SCST_BIO5806e7c6-943d67f38f757694') {{(pid=82054) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe7d8b1-0d2c-4756-b146-e7a21b2c12da]: (4, None) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f1a382-d65d-4e90-8144-4600369ef4b5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd383aa-b901-4ba4-a788-49b6f9443b8f]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988, portal: 172.16.0.220,3260]
Jul 25 15:48:51 user nova-compute[70869]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988, portal: 172.16.0.220,3260] successful.
Jul 25 15:48:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d58a8ee-0acc-4fa8-8ab6-ef341a1b2988 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8da396-d866-471a-8d75-9904d971d200]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] <== disconnect_volume: return (310ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:48:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Deleting instance files /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b_del
Jul 25 15:48:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Deletion of /opt/stack/data/nova/instances/58e838f4-a6e4-4292-a14a-f1e5894c615b_del complete
Jul 25 15:48:51 user nova-compute[70869]: INFO nova.compute.manager [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 25 15:48:51 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:48:51 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:48:52 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:48:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-4f9ad412-e346-4ccd-88c9-e747e8ef581e req-3a0f61b3-4d2b-4f42-9b75-03213a65b229 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-deleted-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:52 user nova-compute[70869]: INFO nova.compute.manager [req-4f9ad412-e346-4ccd-88c9-e747e8ef581e req-3a0f61b3-4d2b-4f42-9b75-03213a65b229 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Neutron deleted interface 8624ca7f-ed89-4043-8c98-806cdf440681; detaching it from the instance and deleting it from the info cache
Jul 25 15:48:52 user nova-compute[70869]: DEBUG nova.network.neutron [req-4f9ad412-e346-4ccd-88c9-e747e8ef581e req-3a0f61b3-4d2b-4f42-9b75-03213a65b229 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:48:52 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Took 0.69 seconds to deallocate network for instance.
Jul 25 15:48:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-4f9ad412-e346-4ccd-88c9-e747e8ef581e req-3a0f61b3-4d2b-4f42-9b75-03213a65b229 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Detach interface failed, port_id=8624ca7f-ed89-4043-8c98-806cdf440681, reason: Instance 58e838f4-a6e4-4292-a14a-f1e5894c615b could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:48:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-7d845400-639d-4925-9af0-71d0bbf67d6e req-6eff1055-4663-4d9e-ab8e-e72ebe071286 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7d845400-639d-4925-9af0-71d0bbf67d6e req-6eff1055-4663-4d9e-ab8e-e72ebe071286 service nova] Acquiring lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7d845400-639d-4925-9af0-71d0bbf67d6e req-6eff1055-4663-4d9e-ab8e-e72ebe071286 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7d845400-639d-4925-9af0-71d0bbf67d6e req-6eff1055-4663-4d9e-ab8e-e72ebe071286 service nova] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-7d845400-639d-4925-9af0-71d0bbf67d6e req-6eff1055-4663-4d9e-ab8e-e72ebe071286 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] No waiting events found dispatching network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:48:53 user nova-compute[70869]: WARNING nova.compute.manager [req-7d845400-639d-4925-9af0-71d0bbf67d6e req-6eff1055-4663-4d9e-ab8e-e72ebe071286 service nova] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Received unexpected event network-vif-plugged-8624ca7f-ed89-4043-8c98-806cdf440681 for instance with vm_state active and task_state deleting.
Jul 25 15:48:53 user nova-compute[70869]: INFO nova.compute.manager [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Took 0.73 seconds to detach 1 volumes for instance.
Jul 25 15:48:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:53 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:48:53 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:48:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:53 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Deleted allocations for instance 58e838f4-a6e4-4292-a14a-f1e5894c615b
Jul 25 15:48:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-238d3a85-3050-4614-a5bc-18f76ca20d0a tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "58e838f4-a6e4-4292-a14a-f1e5894c615b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.052s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:57 user nova-compute[70869]: INFO nova.compute.manager [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Rescuing
Jul 25 15:48:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:48:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquired lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:48:57 user nova-compute[70869]: DEBUG nova.network.neutron [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:48:57 user nova-compute[70869]: DEBUG nova.network.neutron [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updating instance_info_cache with network_info: [{"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:48:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Releasing lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300123.1222847, bfa66e15-724c-4192-b860-5a221b9c0ba3 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:48:58 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] VM Stopped (Lifecycle Event)
Jul 25 15:48:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-fd4a2d88-7373-4488-8c39-769a9cf1f5dc None None] [instance: bfa66e15-724c-4192-b860-5a221b9c0ba3] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-d8470196-f3b1-456b-8fe3-28b39f526864 req-4208ea24-7e9d-40f6-b4d6-e11a1c31de3f service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-unplugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d8470196-f3b1-456b-8fe3-28b39f526864 req-4208ea24-7e9d-40f6-b4d6-e11a1c31de3f service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d8470196-f3b1-456b-8fe3-28b39f526864 req-4208ea24-7e9d-40f6-b4d6-e11a1c31de3f service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d8470196-f3b1-456b-8fe3-28b39f526864 req-4208ea24-7e9d-40f6-b4d6-e11a1c31de3f service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-d8470196-f3b1-456b-8fe3-28b39f526864 req-4208ea24-7e9d-40f6-b4d6-e11a1c31de3f service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-unplugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:48:58 user nova-compute[70869]: WARNING nova.compute.manager [req-d8470196-f3b1-456b-8fe3-28b39f526864 req-4208ea24-7e9d-40f6-b4d6-e11a1c31de3f service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-unplugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state active and task_state rescuing.
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Instance destroyed successfully.
Jul 25 15:48:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Attempting rescue
Jul 25 15:48:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70869) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Instance directory exists: not creating {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 15:48:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Creating image(s)
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG nova.objects.instance [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'trusted_certs' on Instance uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue" returned: 0 in 0.048s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG nova.objects.instance [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'migration_context' on Instance uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Start _get_guest_xml network_info=[{"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "vif_mac": "fa:16:3e:c3:ca:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.objects.instance [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'resources' on Instance uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.objects.instance [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'numa_topology' on Instance uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:59 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:48:59 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.objects.instance [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'vcpu_model' on Instance uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1014341533',display_name='tempest-ServerRescueNegativeTestJSON-server-1014341533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1014341533',id=32,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:47:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-g04b45ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:47:19Z,user_data=None,user_id='2cee3181b38f451a929907b0250f7ae0',uuid=a140f33e-19d2-41fa-9fbe-4b2791e2888c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "vif_mac": "fa:16:3e:c3:ca:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "vif_mac": "fa:16:3e:c3:ca:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ca:36,bridge_name='br-int',has_traffic_filtering=True,id=2f5a47b5-1a92-478f-9edc-c07fccc05ed2,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5a47b5-1a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.objects.instance [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'pci_devices' on Instance uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:48:59 user nova-compute[70869]:   <uuid>a140f33e-19d2-41fa-9fbe-4b2791e2888c</uuid>
Jul 25 15:48:59 user nova-compute[70869]:   <name>instance-00000020</name>
Jul 25 15:48:59 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:48:59 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:48:59 user nova-compute[70869]:   <metadata>
Jul 25 15:48:59 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:48:59 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:48:59 user nova-compute[70869]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1014341533</nova:name>
Jul 25 15:48:59 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:48:59</nova:creationTime>
Jul 25 15:48:59 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:48:59 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:48:59 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:48:59 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:48:59 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:48:59 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:48:59 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:48:59 user nova-compute[70869]:       <nova:owner>
Jul 25 15:48:59 user nova-compute[70869]:         <nova:user uuid="2cee3181b38f451a929907b0250f7ae0">tempest-ServerRescueNegativeTestJSON-2116380302-project-member</nova:user>
Jul 25 15:48:59 user nova-compute[70869]:         <nova:project uuid="40a65674a8194f93a976d52353da0c39">tempest-ServerRescueNegativeTestJSON-2116380302</nova:project>
Jul 25 15:48:59 user nova-compute[70869]:       </nova:owner>
Jul 25 15:48:59 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:48:59 user nova-compute[70869]:       <nova:ports>
Jul 25 15:48:59 user nova-compute[70869]:         <nova:port uuid="2f5a47b5-1a92-478f-9edc-c07fccc05ed2">
Jul 25 15:48:59 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 15:48:59 user nova-compute[70869]:         </nova:port>
Jul 25 15:48:59 user nova-compute[70869]:       </nova:ports>
Jul 25 15:48:59 user nova-compute[70869]:     </nova:instance>
Jul 25 15:48:59 user nova-compute[70869]:   </metadata>
Jul 25 15:48:59 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:48:59 user nova-compute[70869]:     <system>
Jul 25 15:48:59 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:48:59 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:48:59 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:48:59 user nova-compute[70869]:       <entry name="serial">a140f33e-19d2-41fa-9fbe-4b2791e2888c</entry>
Jul 25 15:48:59 user nova-compute[70869]:       <entry name="uuid">a140f33e-19d2-41fa-9fbe-4b2791e2888c</entry>
Jul 25 15:48:59 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:48:59 user nova-compute[70869]:     </system>
Jul 25 15:48:59 user nova-compute[70869]:   </sysinfo>
Jul 25 15:48:59 user nova-compute[70869]:   <os>
Jul 25 15:48:59 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:48:59 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:48:59 user nova-compute[70869]:   </os>
Jul 25 15:48:59 user nova-compute[70869]:   <features>
Jul 25 15:48:59 user nova-compute[70869]:     <acpi/>
Jul 25 15:48:59 user nova-compute[70869]:     <apic/>
Jul 25 15:48:59 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:48:59 user nova-compute[70869]:   </features>
Jul 25 15:48:59 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:48:59 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:48:59 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:48:59 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:48:59 user nova-compute[70869]:   </clock>
Jul 25 15:48:59 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:48:59 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:48:59 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:48:59 user nova-compute[70869]:   </cpu>
Jul 25 15:48:59 user nova-compute[70869]:   <devices>
Jul 25 15:48:59 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:48:59 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:48:59 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue"/>
Jul 25 15:48:59 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:48:59 user nova-compute[70869]:     </disk>
Jul 25 15:48:59 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:48:59 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:48:59 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk"/>
Jul 25 15:48:59 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:48:59 user nova-compute[70869]:     </disk>
Jul 25 15:48:59 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:48:59 user nova-compute[70869]:       <mac address="fa:16:3e:c3:ca:36"/>
Jul 25 15:48:59 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:48:59 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:48:59 user nova-compute[70869]:       <target dev="tap2f5a47b5-1a"/>
Jul 25 15:48:59 user nova-compute[70869]:     </interface>
Jul 25 15:48:59 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:48:59 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/console.log" append="off"/>
Jul 25 15:48:59 user nova-compute[70869]:     </serial>
Jul 25 15:48:59 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:48:59 user nova-compute[70869]:     <video>
Jul 25 15:48:59 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:48:59 user nova-compute[70869]:     </video>
Jul 25 15:48:59 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:48:59 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:48:59 user nova-compute[70869]:     </rng>
Jul 25 15:48:59 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:48:59 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:48:59 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:48:59 user nova-compute[70869]:     </memballoon>
Jul 25 15:48:59 user nova-compute[70869]:   </devices>
Jul 25 15:48:59 user nova-compute[70869]: </domain>
Jul 25 15:48:59 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:48:59 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Instance destroyed successfully.
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No VIF found with MAC fa:16:3e:c3:ca:36, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:48:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:00 user nova-compute[70869]: WARNING nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state active and task_state rescuing.
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:00 user nova-compute[70869]: WARNING nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state active and task_state rescuing.
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:00 user nova-compute[70869]: WARNING nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state active and task_state rescuing.
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-unplugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-unplugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:00 user nova-compute[70869]: WARNING nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-unplugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state active and task_state rescuing.
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:00 user nova-compute[70869]: WARNING nova.compute.manager [req-b106ae44-237f-4afe-a98a-159ec8012ac6 req-089fd9d7-6fa6-443c-9d0c-bc26bb603b5d service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state active and task_state rescuing.
Jul 25 15:49:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:02 user nova-compute[70869]: WARNING nova.compute.manager [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state active and task_state rescuing.
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:02 user nova-compute[70869]: WARNING nova.compute.manager [req-f17f82a9-e377-434e-8fc3-cdcade70baa8 req-65d183ce-45a5-46c3-b6dc-3b97c7c3064f service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state active and task_state rescuing.
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for a140f33e-19d2-41fa-9fbe-4b2791e2888c due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300142.658478, a140f33e-19d2-41fa-9fbe-4b2791e2888c => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:49:02 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] VM Resumed (Lifecycle Event)
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-23476275-501a-43b4-9369-5a984845d7a7 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:49:02 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300142.6603098, a140f33e-19d2-41fa-9fbe-4b2791e2888c => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:49:02 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] VM Started (Lifecycle Event)
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG nova.objects.instance [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'flavor' on Instance uuid fc8f7a35-cb25-469d-ba79-832b8e6aaba0 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:03 user nova-compute[70869]: INFO nova.compute.manager [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Attaching volume c1c4099f-6ff6-47d1-80b1-739fc52e6270 to /dev/vdb
Jul 25 15:49:03 user nova-compute[70869]: DEBUG os_brick.utils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[915d3f1c-020b-4ed1-b4c8-b7f551e71111]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff3bfd9-2e57-44ee-8511-e2b5f5720dc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf5b737-2325-491b-addc-265c0738489a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1989e84-f270-4e61-a394-1065d037bdf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:49:03 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:49:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e207895-3fdb-41d9-af9e-aa0179d9241d]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG os_brick.utils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:49:03 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating existing volume attachment record: b2e759ba-0a86-4d31-8e82-d7035a786147 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:49:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:06 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300131.4175274, 58e838f4-a6e4-4292-a14a-f1e5894c615b => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:49:06 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] VM Stopped (Lifecycle Event)
Jul 25 15:49:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a62dbd78-b685-420c-a252-3f62559cc1fd None None] [instance: 58e838f4-a6e4-4292-a14a-f1e5894c615b] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVYrLuBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:49:10 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:49:10 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:49:10 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b210304-f2ca-4d4a-9d50-d8a0db08106b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:49:10 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9c8d39-0598-4b5b-9850-d021106262d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270] added
Jul 25 15:49:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9abe58-40fd-4335-8b11-516f85b4b67b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d732234-ee40-4f8a-8d2a-d6c942367acb]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVYrLuBJ {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVYrLuBJ" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a382f4e2-acc3-4f71-9146-a90489cbb465]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SVYrLuBJ'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2cf99-b8fe-4f04-8c64-f61ed31d4338]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3866327a-02a5-4b85-8e6b-9c6cb6d589cc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb09890-7bba-4b89-a04b-9a27623d12be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270, portal: 172.16.0.220,3260]
Jul 25 15:49:10 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270, portal: 172.16.0.220,3260] successful.
Jul 25 15:49:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[516f5529-4f17-479a-96ce-da0f15ba1ceb]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0085c37-7daf-4414-acf2-645ade31c9d0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:10 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:49:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:10 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:49:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce6fe8-da46-458f-8a74-eaaaaa71fc8b]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:49:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVYrLuBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23431336463313163', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431336463313163', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG nova.objects.instance [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'flavor' on Instance uuid fc8f7a35-cb25-469d-ba79-832b8e6aaba0 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:49:11 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:49:11 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:49:11 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:49:11 user nova-compute[70869]:   <serial>c1c4099f-6ff6-47d1-80b1-739fc52e6270</serial>
Jul 25 15:49:11 user nova-compute[70869]: </disk>
Jul 25 15:49:11 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:49:11 user nova-compute[70869]: INFO nova.compute.claims [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Claim successful on node user
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] No VIF found with MAC fa:16:3e:95:c6:94, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-10bf5dbf-fb05-4085-adb5-fc26c1226beb tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.806s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:49:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.policy [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '713c16113e88444fb17474020846c914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda092d639f48ae873b25823e3547fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:49:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Creating image(s)
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.178s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.182s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk 1073741824" returned: 0 in 0.060s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Cannot resize image /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'migration_context' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Ensure instance console log exists: /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:13 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Successfully created port: fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Successfully updated port: fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquired lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-6b1f3e48-cf24-407f-85f9-0164f984b0d1 req-d38c11b8-7a7e-4068-957e-728c99e93ab8 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-changed-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-6b1f3e48-cf24-407f-85f9-0164f984b0d1 req-d38c11b8-7a7e-4068-957e-728c99e93ab8 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Refreshing instance network info cache due to event network-changed-fc82c8ce-2156-4af8-97c8-5de08f051d07. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6b1f3e48-cf24-407f-85f9-0164f984b0d1 req-d38c11b8-7a7e-4068-957e-728c99e93ab8 service nova] Acquiring lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updating instance_info_cache with network_info: [{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Releasing lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance network_info: |[{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6b1f3e48-cf24-407f-85f9-0164f984b0d1 req-d38c11b8-7a7e-4068-957e-728c99e93ab8 service nova] Acquired lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.network.neutron [req-6b1f3e48-cf24-407f-85f9-0164f984b0d1 req-d38c11b8-7a7e-4068-957e-728c99e93ab8 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Refreshing network info cache for port fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Start _get_guest_xml network_info=[{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:49:14 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:49:14 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1065132208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1065132208',id=34,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF0ANaxRmVSCrp5TNnfTSdH57zDshrQQgFfIGImg+oIYvFUVNtzacx9oJXoT1aN4jpciZXHWYDXwvMLVFSDUIpzfr97MGx7HKNfVv5///H4sfG8nWsMJvtcelfDh6Ni+w==',key_name='tempest-keypair-1502387404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-i3po3re1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=90bbd516-9124-423e-9bc8-2795c4e39c0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'pci_devices' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:49:14 user nova-compute[70869]:   <uuid>90bbd516-9124-423e-9bc8-2795c4e39c0e</uuid>
Jul 25 15:49:14 user nova-compute[70869]:   <name>instance-00000022</name>
Jul 25 15:49:14 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:49:14 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:49:14 user nova-compute[70869]:   <metadata>
Jul 25 15:49:14 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:49:14 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:49:14 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1065132208</nova:name>
Jul 25 15:49:14 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:49:14</nova:creationTime>
Jul 25 15:49:14 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:49:14 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:49:14 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:49:14 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:49:14 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:49:14 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:49:14 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:49:14 user nova-compute[70869]:       <nova:owner>
Jul 25 15:49:14 user nova-compute[70869]:         <nova:user uuid="713c16113e88444fb17474020846c914">tempest-AttachVolumeShelveTestJSON-1783080081-project-member</nova:user>
Jul 25 15:49:14 user nova-compute[70869]:         <nova:project uuid="fbda092d639f48ae873b25823e3547fe">tempest-AttachVolumeShelveTestJSON-1783080081</nova:project>
Jul 25 15:49:14 user nova-compute[70869]:       </nova:owner>
Jul 25 15:49:14 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:49:14 user nova-compute[70869]:       <nova:ports>
Jul 25 15:49:14 user nova-compute[70869]:         <nova:port uuid="fc82c8ce-2156-4af8-97c8-5de08f051d07">
Jul 25 15:49:14 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 15:49:14 user nova-compute[70869]:         </nova:port>
Jul 25 15:49:14 user nova-compute[70869]:       </nova:ports>
Jul 25 15:49:14 user nova-compute[70869]:     </nova:instance>
Jul 25 15:49:14 user nova-compute[70869]:   </metadata>
Jul 25 15:49:14 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:49:14 user nova-compute[70869]:     <system>
Jul 25 15:49:14 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:49:14 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:49:14 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:49:14 user nova-compute[70869]:       <entry name="serial">90bbd516-9124-423e-9bc8-2795c4e39c0e</entry>
Jul 25 15:49:14 user nova-compute[70869]:       <entry name="uuid">90bbd516-9124-423e-9bc8-2795c4e39c0e</entry>
Jul 25 15:49:14 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:49:14 user nova-compute[70869]:     </system>
Jul 25 15:49:14 user nova-compute[70869]:   </sysinfo>
Jul 25 15:49:14 user nova-compute[70869]:   <os>
Jul 25 15:49:14 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:49:14 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:49:14 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:49:14 user nova-compute[70869]:   </os>
Jul 25 15:49:14 user nova-compute[70869]:   <features>
Jul 25 15:49:14 user nova-compute[70869]:     <acpi/>
Jul 25 15:49:14 user nova-compute[70869]:     <apic/>
Jul 25 15:49:14 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:49:14 user nova-compute[70869]:   </features>
Jul 25 15:49:14 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:49:14 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:49:14 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:49:14 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:49:14 user nova-compute[70869]:   </clock>
Jul 25 15:49:14 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:49:14 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:49:14 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:49:14 user nova-compute[70869]:   </cpu>
Jul 25 15:49:14 user nova-compute[70869]:   <devices>
Jul 25 15:49:14 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:49:14 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:49:14 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk"/>
Jul 25 15:49:14 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:49:14 user nova-compute[70869]:     </disk>
Jul 25 15:49:14 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:49:14 user nova-compute[70869]:       <mac address="fa:16:3e:97:15:10"/>
Jul 25 15:49:14 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:49:14 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:49:14 user nova-compute[70869]:       <target dev="tapfc82c8ce-21"/>
Jul 25 15:49:14 user nova-compute[70869]:     </interface>
Jul 25 15:49:14 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:49:14 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/console.log" append="off"/>
Jul 25 15:49:14 user nova-compute[70869]:     </serial>
Jul 25 15:49:14 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:49:14 user nova-compute[70869]:     <video>
Jul 25 15:49:14 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:49:14 user nova-compute[70869]:     </video>
Jul 25 15:49:14 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:49:14 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:49:14 user nova-compute[70869]:     </rng>
Jul 25 15:49:14 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:49:14 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:49:14 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:49:14 user nova-compute[70869]:     </memballoon>
Jul 25 15:49:14 user nova-compute[70869]:   </devices>
Jul 25 15:49:14 user nova-compute[70869]: </domain>
Jul 25 15:49:14 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1065132208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1065132208',id=34,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF0ANaxRmVSCrp5TNnfTSdH57zDshrQQgFfIGImg+oIYvFUVNtzacx9oJXoT1aN4jpciZXHWYDXwvMLVFSDUIpzfr97MGx7HKNfVv5///H4sfG8nWsMJvtcelfDh6Ni+w==',key_name='tempest-keypair-1502387404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-i3po3re1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=90bbd516-9124-423e-9bc8-2795c4e39c0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG os_vif [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc82c8ce-21, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc82c8ce-21, col_values=(('external_ids', {'iface-id': 'fc82c8ce-2156-4af8-97c8-5de08f051d07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:15:10', 'vm-uuid': '90bbd516-9124-423e-9bc8-2795c4e39c0e'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:14 user nova-compute[70869]: INFO os_vif [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21')
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:49:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] No VIF found with MAC fa:16:3e:97:15:10, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG nova.network.neutron [req-6b1f3e48-cf24-407f-85f9-0164f984b0d1 req-d38c11b8-7a7e-4068-957e-728c99e93ab8 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updated VIF entry in instance network info cache for port fc82c8ce-2156-4af8-97c8-5de08f051d07. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG nova.network.neutron [req-6b1f3e48-cf24-407f-85f9-0164f984b0d1 req-d38c11b8-7a7e-4068-957e-728c99e93ab8 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updating instance_info_cache with network_info: [{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6b1f3e48-cf24-407f-85f9-0164f984b0d1 req-d38c11b8-7a7e-4068-957e-728c99e93ab8 service nova] Releasing lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-a2b9b660-850f-49ff-a97b-5d3e26010926 req-47210e88-4150-44bb-96db-5fa2ecff6cf3 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-a2b9b660-850f-49ff-a97b-5d3e26010926 req-47210e88-4150-44bb-96db-5fa2ecff6cf3 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing instance network info cache due to event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a2b9b660-850f-49ff-a97b-5d3e26010926 req-47210e88-4150-44bb-96db-5fa2ecff6cf3 service nova] Acquiring lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a2b9b660-850f-49ff-a97b-5d3e26010926 req-47210e88-4150-44bb-96db-5fa2ecff6cf3 service nova] Acquired lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG nova.network.neutron [req-a2b9b660-850f-49ff-a97b-5d3e26010926 req-47210e88-4150-44bb-96db-5fa2ecff6cf3 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:15 user nova-compute[70869]: INFO nova.compute.manager [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attaching volume 3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a to /dev/vdb
Jul 25 15:49:15 user nova-compute[70869]: DEBUG os_brick.utils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[154e8bfd-94d0-4b1d-9fd2-0e001b8b2bd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46258dc-b045-4ad9-ad72-0693ee9fc03e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a3c9a3-11f0-4044-9440-6e891a546f36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d25ce-737b-453b-a005-7364546e09ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:49:15 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:49:15 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a1e9a-1f2b-4775-a1cd-15e2d7a39f77]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG os_brick.utils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:49:15 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating existing volume attachment record: ed32a0de-f486-49a5-b513-93d2337e0f34 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG nova.network.neutron [req-a2b9b660-850f-49ff-a97b-5d3e26010926 req-47210e88-4150-44bb-96db-5fa2ecff6cf3 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updated VIF entry in instance network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG nova.network.neutron [req-a2b9b660-850f-49ff-a97b-5d3e26010926 req-47210e88-4150-44bb-96db-5fa2ecff6cf3 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating instance_info_cache with network_info: [{"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a2b9b660-850f-49ff-a97b-5d3e26010926 req-47210e88-4150-44bb-96db-5fa2ecff6cf3 service nova] Releasing lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-d8f7960f-f3b0-44af-9f5f-18c43206377b req-861f8207-db45-479e-95e2-e2bf5e31e673 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d8f7960f-f3b0-44af-9f5f-18c43206377b req-861f8207-db45-479e-95e2-e2bf5e31e673 service nova] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d8f7960f-f3b0-44af-9f5f-18c43206377b req-861f8207-db45-479e-95e2-e2bf5e31e673 service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d8f7960f-f3b0-44af-9f5f-18c43206377b req-861f8207-db45-479e-95e2-e2bf5e31e673 service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-d8f7960f-f3b0-44af-9f5f-18c43206377b req-861f8207-db45-479e-95e2-e2bf5e31e673 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] No waiting events found dispatching network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:16 user nova-compute[70869]: WARNING nova.compute.manager [req-d8f7960f-f3b0-44af-9f5f-18c43206377b req-861f8207-db45-479e-95e2-e2bf5e31e673 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received unexpected event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 for instance with vm_state building and task_state spawning.
Jul 25 15:49:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-f5759dde-df71-4af7-9db2-09ebe731447a req-3b4463ee-f472-4603-8ce7-947182df666f service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-f5759dde-df71-4af7-9db2-09ebe731447a req-3b4463ee-f472-4603-8ce7-947182df666f service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing instance network info cache due to event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:49:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f5759dde-df71-4af7-9db2-09ebe731447a req-3b4463ee-f472-4603-8ce7-947182df666f service nova] Acquiring lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:49:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f5759dde-df71-4af7-9db2-09ebe731447a req-3b4463ee-f472-4603-8ce7-947182df666f service nova] Acquired lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:49:17 user nova-compute[70869]: DEBUG nova.network.neutron [req-f5759dde-df71-4af7-9db2-09ebe731447a req-3b4463ee-f472-4603-8ce7-947182df666f service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:18 user nova-compute[70869]: INFO nova.compute.manager [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Rebooting instance
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.network.neutron [req-f5759dde-df71-4af7-9db2-09ebe731447a req-3b4463ee-f472-4603-8ce7-947182df666f service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updated VIF entry in instance network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.network.neutron [req-f5759dde-df71-4af7-9db2-09ebe731447a req-3b4463ee-f472-4603-8ce7-947182df666f service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating instance_info_cache with network_info: [{"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f5759dde-df71-4af7-9db2-09ebe731447a req-3b4463ee-f472-4603-8ce7-947182df666f service nova] Releasing lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquired lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.network.neutron [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-545bd63e-a93e-4f6b-ae0a-972602ed2c8c req-13b46dd7-d9b5-4566-93bd-cccad73b4597 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-545bd63e-a93e-4f6b-ae0a-972602ed2c8c req-13b46dd7-d9b5-4566-93bd-cccad73b4597 service nova] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-545bd63e-a93e-4f6b-ae0a-972602ed2c8c req-13b46dd7-d9b5-4566-93bd-cccad73b4597 service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-545bd63e-a93e-4f6b-ae0a-972602ed2c8c req-13b46dd7-d9b5-4566-93bd-cccad73b4597 service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.compute.manager [req-545bd63e-a93e-4f6b-ae0a-972602ed2c8c req-13b46dd7-d9b5-4566-93bd-cccad73b4597 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] No waiting events found dispatching network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:18 user nova-compute[70869]: WARNING nova.compute.manager [req-545bd63e-a93e-4f6b-ae0a-972602ed2c8c req-13b46dd7-d9b5-4566-93bd-cccad73b4597 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received unexpected event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 for instance with vm_state building and task_state spawning.
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300158.5714796, 90bbd516-9124-423e-9bc8-2795c4e39c0e => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:49:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] VM Resumed (Lifecycle Event)
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:49:18 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance spawned successfully.
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:49:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300158.5758634, 90bbd516-9124-423e-9bc8-2795c4e39c0e => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:49:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] VM Started (Lifecycle Event)
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:49:18 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:49:18 user nova-compute[70869]: INFO nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Took 6.26 seconds to spawn the instance on the hypervisor.
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:18 user nova-compute[70869]: INFO nova.compute.manager [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Took 7.08 seconds to build instance.
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e3f612a8-97a2-4dd2-b2b9-8516112e5147 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.204s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.network.neutron [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating instance_info_cache with network_info: [{"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Releasing lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:49:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:21 user nova-compute[70869]: DEBUG nova.compute.manager [req-78fdd4b7-0aab-44f8-84ad-48bae333d663 req-5457bf76-2c23-4bb3-93a4-4577c9c27d3f service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-unplugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-78fdd4b7-0aab-44f8-84ad-48bae333d663 req-5457bf76-2c23-4bb3-93a4-4577c9c27d3f service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-78fdd4b7-0aab-44f8-84ad-48bae333d663 req-5457bf76-2c23-4bb3-93a4-4577c9c27d3f service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-78fdd4b7-0aab-44f8-84ad-48bae333d663 req-5457bf76-2c23-4bb3-93a4-4577c9c27d3f service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:21 user nova-compute[70869]: DEBUG nova.compute.manager [req-78fdd4b7-0aab-44f8-84ad-48bae333d663 req-5457bf76-2c23-4bb3-93a4-4577c9c27d3f service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-unplugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:21 user nova-compute[70869]: WARNING nova.compute.manager [req-78fdd4b7-0aab-44f8-84ad-48bae333d663 req-5457bf76-2c23-4bb3-93a4-4577c9c27d3f service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-unplugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state active and task_state reboot_started.
Jul 25 15:49:22 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Instance shutdown successfully.
Jul 25 15:49:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRyGZWvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:49:23 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:49:23 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:49:23 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa651234-db92-4703-b82d-9063c65c1345]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:49:23 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[36729f04-6b9e-429a-8efb-3af15342d869]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a] added
Jul 25 15:49:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fc8d07-ab33-4573-a243-7ee5c02680a7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec42bb66-d5e2-4f58-aac8-27c59cb9cc0e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRyGZWvc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRyGZWvc" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[03acd02c-d0be-49f3-8186-8532f3c505ba]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KRyGZWvc'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cd9630-af04-43fb-b38d-5b7330ab1724]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b2ad7-cfcb-46d0-b6a8-1fb389d8869d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:23 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:49:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:23 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:49:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c57babb-9301-43b8-bb0c-4d95a849909d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a, portal: 172.16.0.220,3260]
Jul 25 15:49:23 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a, portal: 172.16.0.220,3260] successful.
Jul 25 15:49:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a970d17d-3f09-422c-9b1e-5d7a6246c4c3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:23 user nova-compute[70869]: WARNING nova.compute.manager [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state active and task_state reboot_started.
Jul 25 15:49:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:23 user nova-compute[70869]: WARNING nova.compute.manager [req-a8e4d9ad-ea49-443e-a5d8-411e967b8376 req-a8a2ab96-ff5b-4dda-b17f-80a3700799df service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state active and task_state reboot_started.
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03e8b7c-356f-43c7-9acd-233c2afd2b58]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:23 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:49:23 user nova-compute[70869]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a (non-flash)
Jul 25 15:49:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:23 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:49:23 user nova-compute[70869]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a (non-flash)
Jul 25 15:49:23 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f446ad-01a8-4cc9-92ff-906cd1d5357d]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:49:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRyGZWvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23964626134363539', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964626134363539', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:49:24 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:49:24 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:49:24 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:49:24 user nova-compute[70869]:   <serial>3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a</serial>
Jul 25 15:49:24 user nova-compute[70869]: </disk>
Jul 25 15:49:24 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] No VIF found with MAC fa:16:3e:10:17:8d, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ff5ad86c-9973-405f-a3bc-2043195be238 tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.857s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-be2a6ccc-0688-45b9-a59b-687ca97104b0 req-f0ab73c2-b781-41c6-a39e-7646b19edd6d service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be2a6ccc-0688-45b9-a59b-687ca97104b0 req-f0ab73c2-b781-41c6-a39e-7646b19edd6d service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be2a6ccc-0688-45b9-a59b-687ca97104b0 req-f0ab73c2-b781-41c6-a39e-7646b19edd6d service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be2a6ccc-0688-45b9-a59b-687ca97104b0 req-f0ab73c2-b781-41c6-a39e-7646b19edd6d service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-be2a6ccc-0688-45b9-a59b-687ca97104b0 req-f0ab73c2-b781-41c6-a39e-7646b19edd6d service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:25 user nova-compute[70869]: WARNING nova.compute.manager [req-be2a6ccc-0688-45b9-a59b-687ca97104b0 req-f0ab73c2-b781-41c6-a39e-7646b19edd6d service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state active and task_state reboot_started.
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for fc8f7a35-cb25-469d-ba79-832b8e6aaba0 due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300165.8710563, fc8f7a35-cb25-469d-ba79-832b8e6aaba0 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:49:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] VM Resumed (Lifecycle Event)
Jul 25 15:49:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Instance running successfully.
Jul 25 15:49:25 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Instance soft rebooted successfully.
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:49:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300165.8711734, fc8f7a35-cb25-469d-ba79-832b8e6aaba0 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:49:25 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] VM Started (Lifecycle Event)
Jul 25 15:49:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-de382839-0371-4eb3-a5d0-e78963e0a5b4 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.643s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:25 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:28 user nova-compute[70869]: INFO nova.compute.manager [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Detaching volume 3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a
Jul 25 15:49:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:28 user nova-compute[70869]: INFO nova.virt.block_device [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Attempting to driver detach volume 3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a from mountpoint /dev/vdb
Jul 25 15:49:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Attempting to detach device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:49:28 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:49:28 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:49:28 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:49:28 user nova-compute[70869]:   <serial>3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a</serial>
Jul 25 15:49:28 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:49:28 user nova-compute[70869]: </disk>
Jul 25 15:49:28 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:49:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully detached device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the persistent domain config.
Jul 25 15:49:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:49:28 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:49:28 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:49:28 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:49:28 user nova-compute[70869]:   <serial>3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a</serial>
Jul 25 15:49:28 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:49:28 user nova-compute[70869]: </disk>
Jul 25 15:49:28 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300168.9276767, a7211b55-7b3f-455b-b185-4e6432faf006 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:49:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully detached device vdb from instance a7211b55-7b3f-455b-b185-4e6432faf006 from the live domain config.
Jul 25 15:49:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRyGZWvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:49:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:49:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfb50c2-44b9-4700-b0b7-dc4421a888c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:49:28 user nova-compute[70869]: No targets found.
Jul 25 15:49:28 user nova-compute[70869]: iSNS:
Jul 25 15:49:28 user nova-compute[70869]: No targets found.
Jul 25 15:49:28 user nova-compute[70869]: STATIC:
Jul 25 15:49:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a
Jul 25 15:49:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:49:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:49:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:49:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:49:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:49:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270
Jul 25 15:49:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:49:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:49:28 user nova-compute[70869]: FIRMWARE:
Jul 25 15:49:28 user nova-compute[70869]: No targets found.
Jul 25 15:49:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:49:28 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:49:28 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efcd96c-ef0a-4452-8542-990186954a2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[042efd4d-354b-4fdc-bcaf-948f1a783c13]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:29 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:49:29 user nova-compute[70869]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a (non-flash)
Jul 25 15:49:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:49:29 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:49:29 user nova-compute[70869]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a (non-flash)
Jul 25 15:49:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe443248310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0536ac83-4637-4bc8-8005-36f7c89e325c]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cea475-709c-42f3-942f-2128ec241150]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0480173e-e4b5-4370-a33c-cfe0094b1c32]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[33efe25c-50b5-4fbe-90dd-72af7e557f27]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa81c2-954d-4c06-aa85-fccb6ed978ae]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ac0efe-957c-46f8-b04b-d41a05e08a3a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a, portal: 172.16.0.220,3260]
Jul 25 15:49:29 user nova-compute[70869]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a, portal: 172.16.0.220,3260] successful.
Jul 25 15:49:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfd8a26-b8fa-4e72-8410-7fedb9b1bd8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf851f0-6510-4f3e-9071-08eb28544b78]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] <== disconnect_volume: return (374ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:49:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:30 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'flavor' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4eee84b2-7cd0-4ba4-8a43-2ae20181878f tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.923s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:39 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:49:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-18fc35fb-1ce7-4744-9189-1d80ede0a230" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:49:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-18fc35fb-1ce7-4744-9189-1d80ede0a230" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:49:39 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:49:40 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Updating instance_info_cache with network_info: [{"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-18fc35fb-1ce7-4744-9189-1d80ede0a230" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:49:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:49:40 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:40 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "18fc35fb-1ce7-4744-9189-1d80ede0a230" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:41 user nova-compute[70869]: INFO nova.compute.manager [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Terminating instance
Jul 25 15:49:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-ee6ec0a5-a754-4e33-8497-6a3452b96b64 req-f68285e8-321e-4f05-8642-9cd59ca8c111 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received event network-vif-unplugged-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ee6ec0a5-a754-4e33-8497-6a3452b96b64 req-f68285e8-321e-4f05-8642-9cd59ca8c111 service nova] Acquiring lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ee6ec0a5-a754-4e33-8497-6a3452b96b64 req-f68285e8-321e-4f05-8642-9cd59ca8c111 service nova] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ee6ec0a5-a754-4e33-8497-6a3452b96b64 req-f68285e8-321e-4f05-8642-9cd59ca8c111 service nova] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-ee6ec0a5-a754-4e33-8497-6a3452b96b64 req-f68285e8-321e-4f05-8642-9cd59ca8c111 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] No waiting events found dispatching network-vif-unplugged-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-ee6ec0a5-a754-4e33-8497-6a3452b96b64 req-f68285e8-321e-4f05-8642-9cd59ca8c111 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received event network-vif-unplugged-f7dcd88f-e941-4e13-8e75-ff571f37837e for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Instance destroyed successfully.
Jul 25 15:49:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'resources' on Instance uuid 18fc35fb-1ce7-4744-9189-1d80ede0a230 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:40:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-585867573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-585867573',id=23,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:40:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-dcyhpzen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:42:15Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=18fc35fb-1ce7-4744-9189-1d80ede0a230,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "address": "fa:16:3e:b6:91:95", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dcd88f-e9", "ovs_interfaceid": "f7dcd88f-e941-4e13-8e75-ff571f37837e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:91:95,bridge_name='br-int',has_traffic_filtering=True,id=f7dcd88f-e941-4e13-8e75-ff571f37837e,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dcd88f-e9') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG os_vif [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:91:95,bridge_name='br-int',has_traffic_filtering=True,id=f7dcd88f-e941-4e13-8e75-ff571f37837e,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dcd88f-e9') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7dcd88f-e9, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:49:42 user nova-compute[70869]: INFO os_vif [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:91:95,bridge_name='br-int',has_traffic_filtering=True,id=f7dcd88f-e941-4e13-8e75-ff571f37837e,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dcd88f-e9')
Jul 25 15:49:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Deleting instance files /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230_del
Jul 25 15:49:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Deletion of /opt/stack/data/nova/instances/18fc35fb-1ce7-4744-9189-1d80ede0a230_del complete
Jul 25 15:49:42 user nova-compute[70869]: INFO nova.compute.manager [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 25 15:49:42 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-1c63f4ea-53cb-4e02-bc87-7850092b7b1f req-fdd23869-a649-4f2e-ac19-111d901dc092 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received event network-vif-deleted-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:43 user nova-compute[70869]: INFO nova.compute.manager [req-1c63f4ea-53cb-4e02-bc87-7850092b7b1f req-fdd23869-a649-4f2e-ac19-111d901dc092 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Neutron deleted interface f7dcd88f-e941-4e13-8e75-ff571f37837e; detaching it from the instance and deleting it from the info cache
Jul 25 15:49:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-1c63f4ea-53cb-4e02-bc87-7850092b7b1f req-fdd23869-a649-4f2e-ac19-111d901dc092 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:43 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Took 0.75 seconds to deallocate network for instance.
Jul 25 15:49:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-1c63f4ea-53cb-4e02-bc87-7850092b7b1f req-fdd23869-a649-4f2e-ac19-111d901dc092 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Detach interface failed, port_id=f7dcd88f-e941-4e13-8e75-ff571f37837e, reason: Instance 18fc35fb-1ce7-4744-9189-1d80ede0a230 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:43 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Deleted allocations for instance 18fc35fb-1ce7-4744-9189-1d80ede0a230
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:43 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '18fc35fb-1ce7-4744-9189-1d80ede0a230' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '18fc35fb-1ce7-4744-9189-1d80ede0a230' (instance-00000017)
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1049c054-e563-48c4-a7a3-6118780a2fc0 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-e06a007c-f754-4d6d-b940-713299da6ca3 req-69a28d16-cf92-4de6-8458-a20d293ceca2 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received event network-vif-plugged-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e06a007c-f754-4d6d-b940-713299da6ca3 req-69a28d16-cf92-4de6-8458-a20d293ceca2 service nova] Acquiring lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e06a007c-f754-4d6d-b940-713299da6ca3 req-69a28d16-cf92-4de6-8458-a20d293ceca2 service nova] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e06a007c-f754-4d6d-b940-713299da6ca3 req-69a28d16-cf92-4de6-8458-a20d293ceca2 service nova] Lock "18fc35fb-1ce7-4744-9189-1d80ede0a230-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-e06a007c-f754-4d6d-b940-713299da6ca3 req-69a28d16-cf92-4de6-8458-a20d293ceca2 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] No waiting events found dispatching network-vif-plugged-f7dcd88f-e941-4e13-8e75-ff571f37837e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:44 user nova-compute[70869]: WARNING nova.compute.manager [req-e06a007c-f754-4d6d-b940-713299da6ca3 req-69a28d16-cf92-4de6-8458-a20d293ceca2 service nova] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Received unexpected event network-vif-plugged-f7dcd88f-e941-4e13-8e75-ff571f37837e for instance with vm_state deleted and task_state None.
Jul 25 15:49:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:49:45 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:49:45 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7828MB free_disk=25.26531982421875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a7211b55-7b3f-455b-b185-4e6432faf006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 90bbd516-9124-423e-9bc8-2795c4e39c0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:49:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:47 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:49:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquiring lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:49:53 user nova-compute[70869]: INFO nova.compute.claims [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Claim successful on node user
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:49:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:49:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Creating image(s)
Jul 25 15:49:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "/opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "/opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG nova.policy [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e52b9a4789f4c3e93d2c3857ac8cce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b352631168e845c8902d50249f4c81a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk 1073741824" returned: 0 in 0.052s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Cannot resize image /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lazy-loading 'migration_context' on Instance uuid 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Ensure instance console log exists: /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:54 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Successfully created port: 52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Successfully updated port: 52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquiring lock "refresh_cache-4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquired lock "refresh_cache-4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-f1d26db3-93cd-4778-a7f5-7652e69b27a0 req-edab17ad-19b3-4a3b-8365-716f56407e11 service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received event network-changed-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.compute.manager [req-f1d26db3-93cd-4778-a7f5-7652e69b27a0 req-edab17ad-19b3-4a3b-8365-716f56407e11 service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Refreshing instance network info cache due to event network-changed-52a923e8-8329-483f-8128-b3da4ebf69e9. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f1d26db3-93cd-4778-a7f5-7652e69b27a0 req-edab17ad-19b3-4a3b-8365-716f56407e11 service nova] Acquiring lock "refresh_cache-4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Updating instance_info_cache with network_info: [{"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Releasing lock "refresh_cache-4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Instance network_info: |[{"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f1d26db3-93cd-4778-a7f5-7652e69b27a0 req-edab17ad-19b3-4a3b-8365-716f56407e11 service nova] Acquired lock "refresh_cache-4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.neutron [req-f1d26db3-93cd-4778-a7f5-7652e69b27a0 req-edab17ad-19b3-4a3b-8365-716f56407e11 service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Refreshing network info cache for port 52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Start _get_guest_xml network_info=[{"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:49:56 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:49:56 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1895126806',display_name='tempest-VolumesNegativeTest-instance-1895126806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1895126806',id=35,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b352631168e845c8902d50249f4c81a0',ramdisk_id='',reservation_id='r-b788r2xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1028621959',owner_user_name='tempest-VolumesNegativeTest-1028621959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:49:54Z,user_data=None,user_id='0e52b9a4789f4c3e93d2c3857ac8cce2',uuid=4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Converting VIF {"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5d:32,bridge_name='br-int',has_traffic_filtering=True,id=52a923e8-8329-483f-8128-b3da4ebf69e9,network=Network(75c29593-ba52-4032-bbc1-4efe36137b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a923e8-83') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:49:56 user nova-compute[70869]:   <uuid>4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9</uuid>
Jul 25 15:49:56 user nova-compute[70869]:   <name>instance-00000023</name>
Jul 25 15:49:56 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:49:56 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:49:56 user nova-compute[70869]:   <metadata>
Jul 25 15:49:56 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:49:56 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:49:56 user nova-compute[70869]:       <nova:name>tempest-VolumesNegativeTest-instance-1895126806</nova:name>
Jul 25 15:49:56 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:49:56</nova:creationTime>
Jul 25 15:49:56 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:49:56 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:49:56 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:49:56 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:49:56 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:49:56 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:49:56 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:49:56 user nova-compute[70869]:       <nova:owner>
Jul 25 15:49:56 user nova-compute[70869]:         <nova:user uuid="0e52b9a4789f4c3e93d2c3857ac8cce2">tempest-VolumesNegativeTest-1028621959-project-member</nova:user>
Jul 25 15:49:56 user nova-compute[70869]:         <nova:project uuid="b352631168e845c8902d50249f4c81a0">tempest-VolumesNegativeTest-1028621959</nova:project>
Jul 25 15:49:56 user nova-compute[70869]:       </nova:owner>
Jul 25 15:49:56 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:49:56 user nova-compute[70869]:       <nova:ports>
Jul 25 15:49:56 user nova-compute[70869]:         <nova:port uuid="52a923e8-8329-483f-8128-b3da4ebf69e9">
Jul 25 15:49:56 user nova-compute[70869]:           <nova:ip type="fixed" address="192.168.233.21" ipVersion="4"/>
Jul 25 15:49:56 user nova-compute[70869]:         </nova:port>
Jul 25 15:49:56 user nova-compute[70869]:       </nova:ports>
Jul 25 15:49:56 user nova-compute[70869]:     </nova:instance>
Jul 25 15:49:56 user nova-compute[70869]:   </metadata>
Jul 25 15:49:56 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:49:56 user nova-compute[70869]:     <system>
Jul 25 15:49:56 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:49:56 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:49:56 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:49:56 user nova-compute[70869]:       <entry name="serial">4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9</entry>
Jul 25 15:49:56 user nova-compute[70869]:       <entry name="uuid">4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9</entry>
Jul 25 15:49:56 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:49:56 user nova-compute[70869]:     </system>
Jul 25 15:49:56 user nova-compute[70869]:   </sysinfo>
Jul 25 15:49:56 user nova-compute[70869]:   <os>
Jul 25 15:49:56 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:49:56 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:49:56 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:49:56 user nova-compute[70869]:   </os>
Jul 25 15:49:56 user nova-compute[70869]:   <features>
Jul 25 15:49:56 user nova-compute[70869]:     <acpi/>
Jul 25 15:49:56 user nova-compute[70869]:     <apic/>
Jul 25 15:49:56 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:49:56 user nova-compute[70869]:   </features>
Jul 25 15:49:56 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:49:56 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:49:56 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:49:56 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:49:56 user nova-compute[70869]:   </clock>
Jul 25 15:49:56 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:49:56 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:49:56 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:49:56 user nova-compute[70869]:   </cpu>
Jul 25 15:49:56 user nova-compute[70869]:   <devices>
Jul 25 15:49:56 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:49:56 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:49:56 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk"/>
Jul 25 15:49:56 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:49:56 user nova-compute[70869]:     </disk>
Jul 25 15:49:56 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:49:56 user nova-compute[70869]:       <mac address="fa:16:3e:e1:5d:32"/>
Jul 25 15:49:56 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:49:56 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:49:56 user nova-compute[70869]:       <target dev="tap52a923e8-83"/>
Jul 25 15:49:56 user nova-compute[70869]:     </interface>
Jul 25 15:49:56 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:49:56 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/console.log" append="off"/>
Jul 25 15:49:56 user nova-compute[70869]:     </serial>
Jul 25 15:49:56 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:49:56 user nova-compute[70869]:     <video>
Jul 25 15:49:56 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:49:56 user nova-compute[70869]:     </video>
Jul 25 15:49:56 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:49:56 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:49:56 user nova-compute[70869]:     </rng>
Jul 25 15:49:56 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:49:56 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:49:56 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:49:56 user nova-compute[70869]:     </memballoon>
Jul 25 15:49:56 user nova-compute[70869]:   </devices>
Jul 25 15:49:56 user nova-compute[70869]: </domain>
Jul 25 15:49:56 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1895126806',display_name='tempest-VolumesNegativeTest-instance-1895126806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1895126806',id=35,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b352631168e845c8902d50249f4c81a0',ramdisk_id='',reservation_id='r-b788r2xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1028621959',owner_user_name='tempest-VolumesNegativeTest-1028621959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:49:54Z,user_data=None,user_id='0e52b9a4789f4c3e93d2c3857ac8cce2',uuid=4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Converting VIF {"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5d:32,bridge_name='br-int',has_traffic_filtering=True,id=52a923e8-8329-483f-8128-b3da4ebf69e9,network=Network(75c29593-ba52-4032-bbc1-4efe36137b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a923e8-83') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG os_vif [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5d:32,bridge_name='br-int',has_traffic_filtering=True,id=52a923e8-8329-483f-8128-b3da4ebf69e9,network=Network(75c29593-ba52-4032-bbc1-4efe36137b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a923e8-83') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52a923e8-83, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52a923e8-83, col_values=(('external_ids', {'iface-id': '52a923e8-8329-483f-8128-b3da4ebf69e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:5d:32', 'vm-uuid': '4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:56 user nova-compute[70869]: INFO os_vif [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5d:32,bridge_name='br-int',has_traffic_filtering=True,id=52a923e8-8329-483f-8128-b3da4ebf69e9,network=Network(75c29593-ba52-4032-bbc1-4efe36137b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a923e8-83')
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] No VIF found with MAC fa:16:3e:e1:5d:32, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.neutron [req-f1d26db3-93cd-4778-a7f5-7652e69b27a0 req-edab17ad-19b3-4a3b-8365-716f56407e11 service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Updated VIF entry in instance network info cache for port 52a923e8-8329-483f-8128-b3da4ebf69e9. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG nova.network.neutron [req-f1d26db3-93cd-4778-a7f5-7652e69b27a0 req-edab17ad-19b3-4a3b-8365-716f56407e11 service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Updating instance_info_cache with network_info: [{"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:49:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f1d26db3-93cd-4778-a7f5-7652e69b27a0 req-edab17ad-19b3-4a3b-8365-716f56407e11 service nova] Releasing lock "refresh_cache-4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:49:57 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300182.378274, 18fc35fb-1ce7-4744-9189-1d80ede0a230 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:49:57 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] VM Stopped (Lifecycle Event)
Jul 25 15:49:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1ada4199-f213-4d28-b9d8-b913c326ce31 None None] [instance: 18fc35fb-1ce7-4744-9189-1d80ede0a230] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:49:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-44957cd2-08ee-4287-aab3-17b1f4dfd7c2 req-27f6e5f1-7d87-494b-8dba-3610d43245ef service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received event network-vif-plugged-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-44957cd2-08ee-4287-aab3-17b1f4dfd7c2 req-27f6e5f1-7d87-494b-8dba-3610d43245ef service nova] Acquiring lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-44957cd2-08ee-4287-aab3-17b1f4dfd7c2 req-27f6e5f1-7d87-494b-8dba-3610d43245ef service nova] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-44957cd2-08ee-4287-aab3-17b1f4dfd7c2 req-27f6e5f1-7d87-494b-8dba-3610d43245ef service nova] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:49:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-44957cd2-08ee-4287-aab3-17b1f4dfd7c2 req-27f6e5f1-7d87-494b-8dba-3610d43245ef service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] No waiting events found dispatching network-vif-plugged-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:49:58 user nova-compute[70869]: WARNING nova.compute.manager [req-44957cd2-08ee-4287-aab3-17b1f4dfd7c2 req-27f6e5f1-7d87-494b-8dba-3610d43245ef service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received unexpected event network-vif-plugged-52a923e8-8329-483f-8128-b3da4ebf69e9 for instance with vm_state building and task_state spawning.
Jul 25 15:49:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:49:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300200.2284348, 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:50:00 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] VM Resumed (Lifecycle Event)
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:50:00 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Instance spawned successfully.
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:00 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300200.2325332, 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:50:00 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] VM Started (Lifecycle Event)
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:50:00 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:50:00 user nova-compute[70869]: INFO nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Took 6.42 seconds to spawn the instance on the hypervisor.
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:50:00 user nova-compute[70869]: INFO nova.compute.manager [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Took 7.12 seconds to build instance.
Jul 25 15:50:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b61c12c2-0d12-4d48-a726-e1d8e21ce5e3 tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.247s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-2b386e70-ef17-4cc2-9184-f9a54fed6b29 req-a8da11a3-a2fa-4773-99b9-160aff14de2f service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received event network-vif-plugged-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b386e70-ef17-4cc2-9184-f9a54fed6b29 req-a8da11a3-a2fa-4773-99b9-160aff14de2f service nova] Acquiring lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b386e70-ef17-4cc2-9184-f9a54fed6b29 req-a8da11a3-a2fa-4773-99b9-160aff14de2f service nova] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2b386e70-ef17-4cc2-9184-f9a54fed6b29 req-a8da11a3-a2fa-4773-99b9-160aff14de2f service nova] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-2b386e70-ef17-4cc2-9184-f9a54fed6b29 req-a8da11a3-a2fa-4773-99b9-160aff14de2f service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] No waiting events found dispatching network-vif-plugged-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:50:00 user nova-compute[70869]: WARNING nova.compute.manager [req-2b386e70-ef17-4cc2-9184-f9a54fed6b29 req-a8da11a3-a2fa-4773-99b9-160aff14de2f service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received unexpected event network-vif-plugged-52a923e8-8329-483f-8128-b3da4ebf69e9 for instance with vm_state active and task_state None.
Jul 25 15:50:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:09 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:50:10 user nova-compute[70869]: INFO nova.compute.claims [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Claim successful on node user
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:50:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.policy [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0c24788ba1e448095d2d5d7d84b6ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabdedcca7cb44c9b3c76177e53006bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:50:10 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Creating image(s)
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquiring lock "/opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "/opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "/opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk 1073741824" returned: 0 in 0.056s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Checking if we can resize image /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Successfully created port: f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Cannot resize image /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lazy-loading 'migration_context' on Instance uuid 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Ensure instance console log exists: /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Successfully updated port: f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquiring lock "refresh_cache-336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquired lock "refresh_cache-336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c827444-8aae-40e8-b06d-5ebe72e5bb86 req-fbec007b-5fc8-40af-8a25-22e741b00b1c service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-changed-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c827444-8aae-40e8-b06d-5ebe72e5bb86 req-fbec007b-5fc8-40af-8a25-22e741b00b1c service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Refreshing instance network info cache due to event network-changed-f8de4493-31f5-42c7-9bf5-a4ff262308ee. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:50:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c827444-8aae-40e8-b06d-5ebe72e5bb86 req-fbec007b-5fc8-40af-8a25-22e741b00b1c service nova] Acquiring lock "refresh_cache-336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Updating instance_info_cache with network_info: [{"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Releasing lock "refresh_cache-336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Instance network_info: |[{"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c827444-8aae-40e8-b06d-5ebe72e5bb86 req-fbec007b-5fc8-40af-8a25-22e741b00b1c service nova] Acquired lock "refresh_cache-336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-9c827444-8aae-40e8-b06d-5ebe72e5bb86 req-fbec007b-5fc8-40af-8a25-22e741b00b1c service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Refreshing network info cache for port f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Start _get_guest_xml network_info=[{"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:50:12 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:50:12 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1275707219',display_name='tempest-VolumesActionsTest-instance-1275707219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1275707219',id=36,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cabdedcca7cb44c9b3c76177e53006bc',ramdisk_id='',reservation_id='r-0v3eap0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1960082272',owner_user_name='tempest-VolumesActionsTest-1960082272-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:50:11Z,user_data=None,user_id='e0c24788ba1e448095d2d5d7d84b6ca3',uuid=336e00d3-5d9b-4450-9e7d-ef03bc0e3da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Converting VIF {"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4d:a4,bridge_name='br-int',has_traffic_filtering=True,id=f8de4493-31f5-42c7-9bf5-a4ff262308ee,network=Network(82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8de4493-31') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lazy-loading 'pci_devices' on Instance uuid 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:50:12 user nova-compute[70869]:   <uuid>336e00d3-5d9b-4450-9e7d-ef03bc0e3da2</uuid>
Jul 25 15:50:12 user nova-compute[70869]:   <name>instance-00000024</name>
Jul 25 15:50:12 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:50:12 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:50:12 user nova-compute[70869]:   <metadata>
Jul 25 15:50:12 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:50:12 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:50:12 user nova-compute[70869]:       <nova:name>tempest-VolumesActionsTest-instance-1275707219</nova:name>
Jul 25 15:50:12 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:50:12</nova:creationTime>
Jul 25 15:50:12 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:50:12 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:50:12 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:50:12 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:50:12 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:50:12 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:50:12 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:50:12 user nova-compute[70869]:       <nova:owner>
Jul 25 15:50:12 user nova-compute[70869]:         <nova:user uuid="e0c24788ba1e448095d2d5d7d84b6ca3">tempest-VolumesActionsTest-1960082272-project-member</nova:user>
Jul 25 15:50:12 user nova-compute[70869]:         <nova:project uuid="cabdedcca7cb44c9b3c76177e53006bc">tempest-VolumesActionsTest-1960082272</nova:project>
Jul 25 15:50:12 user nova-compute[70869]:       </nova:owner>
Jul 25 15:50:12 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:50:12 user nova-compute[70869]:       <nova:ports>
Jul 25 15:50:12 user nova-compute[70869]:         <nova:port uuid="f8de4493-31f5-42c7-9bf5-a4ff262308ee">
Jul 25 15:50:12 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 15:50:12 user nova-compute[70869]:         </nova:port>
Jul 25 15:50:12 user nova-compute[70869]:       </nova:ports>
Jul 25 15:50:12 user nova-compute[70869]:     </nova:instance>
Jul 25 15:50:12 user nova-compute[70869]:   </metadata>
Jul 25 15:50:12 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:50:12 user nova-compute[70869]:     <system>
Jul 25 15:50:12 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:50:12 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:50:12 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:50:12 user nova-compute[70869]:       <entry name="serial">336e00d3-5d9b-4450-9e7d-ef03bc0e3da2</entry>
Jul 25 15:50:12 user nova-compute[70869]:       <entry name="uuid">336e00d3-5d9b-4450-9e7d-ef03bc0e3da2</entry>
Jul 25 15:50:12 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:50:12 user nova-compute[70869]:     </system>
Jul 25 15:50:12 user nova-compute[70869]:   </sysinfo>
Jul 25 15:50:12 user nova-compute[70869]:   <os>
Jul 25 15:50:12 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:50:12 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:50:12 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:50:12 user nova-compute[70869]:   </os>
Jul 25 15:50:12 user nova-compute[70869]:   <features>
Jul 25 15:50:12 user nova-compute[70869]:     <acpi/>
Jul 25 15:50:12 user nova-compute[70869]:     <apic/>
Jul 25 15:50:12 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:50:12 user nova-compute[70869]:   </features>
Jul 25 15:50:12 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:50:12 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:50:12 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:50:12 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:50:12 user nova-compute[70869]:   </clock>
Jul 25 15:50:12 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:50:12 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:50:12 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:50:12 user nova-compute[70869]:   </cpu>
Jul 25 15:50:12 user nova-compute[70869]:   <devices>
Jul 25 15:50:12 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:50:12 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:50:12 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk"/>
Jul 25 15:50:12 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:50:12 user nova-compute[70869]:     </disk>
Jul 25 15:50:12 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:50:12 user nova-compute[70869]:       <mac address="fa:16:3e:aa:4d:a4"/>
Jul 25 15:50:12 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:50:12 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:50:12 user nova-compute[70869]:       <target dev="tapf8de4493-31"/>
Jul 25 15:50:12 user nova-compute[70869]:     </interface>
Jul 25 15:50:12 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:50:12 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/console.log" append="off"/>
Jul 25 15:50:12 user nova-compute[70869]:     </serial>
Jul 25 15:50:12 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:50:12 user nova-compute[70869]:     <video>
Jul 25 15:50:12 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:50:12 user nova-compute[70869]:     </video>
Jul 25 15:50:12 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:50:12 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:50:12 user nova-compute[70869]:     </rng>
Jul 25 15:50:12 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:50:12 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:50:12 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:50:12 user nova-compute[70869]:     </memballoon>
Jul 25 15:50:12 user nova-compute[70869]:   </devices>
Jul 25 15:50:12 user nova-compute[70869]: </domain>
Jul 25 15:50:12 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1275707219',display_name='tempest-VolumesActionsTest-instance-1275707219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1275707219',id=36,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cabdedcca7cb44c9b3c76177e53006bc',ramdisk_id='',reservation_id='r-0v3eap0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1960082272',owner_user_name='tempest-VolumesActionsTest-1960082272-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:50:11Z,user_data=None,user_id='e0c24788ba1e448095d2d5d7d84b6ca3',uuid=336e00d3-5d9b-4450-9e7d-ef03bc0e3da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Converting VIF {"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4d:a4,bridge_name='br-int',has_traffic_filtering=True,id=f8de4493-31f5-42c7-9bf5-a4ff262308ee,network=Network(82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8de4493-31') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG os_vif [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4d:a4,bridge_name='br-int',has_traffic_filtering=True,id=f8de4493-31f5-42c7-9bf5-a4ff262308ee,network=Network(82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8de4493-31') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8de4493-31, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8de4493-31, col_values=(('external_ids', {'iface-id': 'f8de4493-31f5-42c7-9bf5-a4ff262308ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:4d:a4', 'vm-uuid': '336e00d3-5d9b-4450-9e7d-ef03bc0e3da2'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:12 user nova-compute[70869]: INFO os_vif [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4d:a4,bridge_name='br-int',has_traffic_filtering=True,id=f8de4493-31f5-42c7-9bf5-a4ff262308ee,network=Network(82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8de4493-31')
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] No VIF found with MAC fa:16:3e:aa:4d:a4, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-9c827444-8aae-40e8-b06d-5ebe72e5bb86 req-fbec007b-5fc8-40af-8a25-22e741b00b1c service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Updated VIF entry in instance network info cache for port f8de4493-31f5-42c7-9bf5-a4ff262308ee. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-9c827444-8aae-40e8-b06d-5ebe72e5bb86 req-fbec007b-5fc8-40af-8a25-22e741b00b1c service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Updating instance_info_cache with network_info: [{"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:50:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c827444-8aae-40e8-b06d-5ebe72e5bb86 req-fbec007b-5fc8-40af-8a25-22e741b00b1c service nova] Releasing lock "refresh_cache-336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:50:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-c7d4d5e4-13df-426b-bc57-897cf935ae32 req-dcd7a6f4-56f7-4c04-bd8d-10e7fe988902 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c7d4d5e4-13df-426b-bc57-897cf935ae32 req-dcd7a6f4-56f7-4c04-bd8d-10e7fe988902 service nova] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c7d4d5e4-13df-426b-bc57-897cf935ae32 req-dcd7a6f4-56f7-4c04-bd8d-10e7fe988902 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c7d4d5e4-13df-426b-bc57-897cf935ae32 req-dcd7a6f4-56f7-4c04-bd8d-10e7fe988902 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-c7d4d5e4-13df-426b-bc57-897cf935ae32 req-dcd7a6f4-56f7-4c04-bd8d-10e7fe988902 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] No waiting events found dispatching network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:50:14 user nova-compute[70869]: WARNING nova.compute.manager [req-c7d4d5e4-13df-426b-bc57-897cf935ae32 req-dcd7a6f4-56f7-4c04-bd8d-10e7fe988902 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received unexpected event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee for instance with vm_state building and task_state spawning.
Jul 25 15:50:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300215.8934698, 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:50:15 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] VM Resumed (Lifecycle Event)
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:50:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Instance spawned successfully.
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:50:15 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300215.8948982, 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:50:15 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] VM Started (Lifecycle Event)
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:50:15 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:50:15 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:50:16 user nova-compute[70869]: INFO nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Took 5.35 seconds to spawn the instance on the hypervisor.
Jul 25 15:50:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:50:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-13f19954-70e6-4c61-bfba-ec31f7f8e6a2 req-9f2877ec-5b17-4f58-9c75-4a3302b06eb2 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-13f19954-70e6-4c61-bfba-ec31f7f8e6a2 req-9f2877ec-5b17-4f58-9c75-4a3302b06eb2 service nova] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-13f19954-70e6-4c61-bfba-ec31f7f8e6a2 req-9f2877ec-5b17-4f58-9c75-4a3302b06eb2 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-13f19954-70e6-4c61-bfba-ec31f7f8e6a2 req-9f2877ec-5b17-4f58-9c75-4a3302b06eb2 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-13f19954-70e6-4c61-bfba-ec31f7f8e6a2 req-9f2877ec-5b17-4f58-9c75-4a3302b06eb2 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] No waiting events found dispatching network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:50:16 user nova-compute[70869]: WARNING nova.compute.manager [req-13f19954-70e6-4c61-bfba-ec31f7f8e6a2 req-9f2877ec-5b17-4f58-9c75-4a3302b06eb2 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received unexpected event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee for instance with vm_state building and task_state spawning.
Jul 25 15:50:16 user nova-compute[70869]: INFO nova.compute.manager [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Took 6.06 seconds to build instance.
Jul 25 15:50:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6112d055-4609-4835-a91f-a2f602ea900b tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.163s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:32 user nova-compute[70869]: INFO nova.compute.manager [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Terminating instance
Jul 25 15:50:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-3be5d012-18ee-4ccb-a169-80f23f11f5cb req-f9bf11be-244d-457b-b25d-1b57fb8c313b service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-unplugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3be5d012-18ee-4ccb-a169-80f23f11f5cb req-f9bf11be-244d-457b-b25d-1b57fb8c313b service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3be5d012-18ee-4ccb-a169-80f23f11f5cb req-f9bf11be-244d-457b-b25d-1b57fb8c313b service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3be5d012-18ee-4ccb-a169-80f23f11f5cb req-f9bf11be-244d-457b-b25d-1b57fb8c313b service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-3be5d012-18ee-4ccb-a169-80f23f11f5cb req-f9bf11be-244d-457b-b25d-1b57fb8c313b service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-unplugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-3be5d012-18ee-4ccb-a169-80f23f11f5cb req-f9bf11be-244d-457b-b25d-1b57fb8c313b service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-unplugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:32 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Instance destroyed successfully.
Jul 25 15:50:32 user nova-compute[70869]: DEBUG nova.objects.instance [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'resources' on Instance uuid a525e472-1e7b-40b5-a4b1-5ba8bae313c9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1613461442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1613461442',id=15,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:36:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-1kc1pjj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:38:31Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=a525e472-1e7b-40b5-a4b1-5ba8bae313c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "f433efca-963a-44ce-99c2-b1c4488c564a", "address": "fa:16:3e:4d:77:eb", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf433efca-96", "ovs_interfaceid": "f433efca-963a-44ce-99c2-b1c4488c564a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:77:eb,bridge_name='br-int',has_traffic_filtering=True,id=f433efca-963a-44ce-99c2-b1c4488c564a,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf433efca-96') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_vif [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:77:eb,bridge_name='br-int',has_traffic_filtering=True,id=f433efca-963a-44ce-99c2-b1c4488c564a,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf433efca-96') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf433efca-96, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:33 user nova-compute[70869]: INFO os_vif [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:77:eb,bridge_name='br-int',has_traffic_filtering=True,id=f433efca-963a-44ce-99c2-b1c4488c564a,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf433efca-96')
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgmhefxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:50:33 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1553375-6a3e-487d-b519-7b99108fd5c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:50:33 user nova-compute[70869]: No targets found.
Jul 25 15:50:33 user nova-compute[70869]: iSNS:
Jul 25 15:50:33 user nova-compute[70869]: No targets found.
Jul 25 15:50:33 user nova-compute[70869]: STATIC:
Jul 25 15:50:33 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e
Jul 25 15:50:33 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:50:33 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:50:33 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270
Jul 25 15:50:33 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:50:33 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:50:33 user nova-compute[70869]: FIRMWARE:
Jul 25 15:50:33 user nova-compute[70869]: No targets found.
Jul 25 15:50:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:50:33 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:50:33 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3e0d92-318c-4bc9-a9c6-8c0798c0e45f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aa81fa-cf6a-46d6-af77-99bfe2a7679a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:50:33 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:50:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e (non-flash)
Jul 25 15:50:33 user nova-compute[70869]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:50:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43432dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e'): ({'sdb'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Removing single pathed devices sdb {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[39656f56-7a98-4be4-8c7b-ab6d0a3fa1cb]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f549ec99-aeef-4ea8-8aac-f662cbaa8395]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Flushing IO for device /dev/sdb {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef6cdc4-4a00-49d0-8990-21a261e211c2]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6873ba04-be03-45a9-a90f-5111fdb56043]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[212bf836-384e-49f3-88a6-50c1e4e7ff4e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7b9726-a5b5-4959-911d-62c133a9432a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e, portal: 172.16.0.220,3260]
Jul 25 15:50:33 user nova-compute[70869]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e, portal: 172.16.0.220,3260] successful.
Jul 25 15:50:33 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d4a3f2-1140-4be4-a32c-a56b6661a89e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea492fb-d3df-4f8c-9dd2-ce5076274f3d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] <== disconnect_volume: return (293ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:50:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Deleting instance files /opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9_del
Jul 25 15:50:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Deletion of /opt/stack/data/nova/instances/a525e472-1e7b-40b5-a4b1-5ba8bae313c9_del complete
Jul 25 15:50:33 user nova-compute[70869]: INFO nova.compute.manager [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 25 15:50:33 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-249eb3d6-01f8-4a2d-81f9-6b9e9354b8b9 req-6be56160-2e19-46df-8ed8-98ed36e47715 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-deleted-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:33 user nova-compute[70869]: INFO nova.compute.manager [req-249eb3d6-01f8-4a2d-81f9-6b9e9354b8b9 req-6be56160-2e19-46df-8ed8-98ed36e47715 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Neutron deleted interface f433efca-963a-44ce-99c2-b1c4488c564a; detaching it from the instance and deleting it from the info cache
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-249eb3d6-01f8-4a2d-81f9-6b9e9354b8b9 req-6be56160-2e19-46df-8ed8-98ed36e47715 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:50:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-249eb3d6-01f8-4a2d-81f9-6b9e9354b8b9 req-6be56160-2e19-46df-8ed8-98ed36e47715 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Detach interface failed, port_id=f433efca-963a-44ce-99c2-b1c4488c564a, reason: Instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:50:33 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Took 0.57 seconds to deallocate network for instance.
Jul 25 15:50:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-1706c1de-5b3d-4c18-a22f-a8706818005a req-763acad8-2a91-4c43-bfc0-1ba0ca27b1b9 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1706c1de-5b3d-4c18-a22f-a8706818005a req-763acad8-2a91-4c43-bfc0-1ba0ca27b1b9 service nova] Acquiring lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1706c1de-5b3d-4c18-a22f-a8706818005a req-763acad8-2a91-4c43-bfc0-1ba0ca27b1b9 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1706c1de-5b3d-4c18-a22f-a8706818005a req-763acad8-2a91-4c43-bfc0-1ba0ca27b1b9 service nova] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-1706c1de-5b3d-4c18-a22f-a8706818005a req-763acad8-2a91-4c43-bfc0-1ba0ca27b1b9 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] No waiting events found dispatching network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:50:34 user nova-compute[70869]: WARNING nova.compute.manager [req-1706c1de-5b3d-4c18-a22f-a8706818005a req-763acad8-2a91-4c43-bfc0-1ba0ca27b1b9 service nova] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Received unexpected event network-vif-plugged-f433efca-963a-44ce-99c2-b1c4488c564a for instance with vm_state active and task_state deleting.
Jul 25 15:50:34 user nova-compute[70869]: INFO nova.compute.manager [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Took 0.75 seconds to detach 1 volumes for instance.
Jul 25 15:50:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:35 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:50:35 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:50:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:35 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Deleted allocations for instance a525e472-1e7b-40b5-a4b1-5ba8bae313c9
Jul 25 15:50:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87c38eec-4730-47c4-86dd-1276d2eaf1c7 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "a525e472-1e7b-40b5-a4b1-5ba8bae313c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.991s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:40 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:50:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:50:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:50:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:50:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:50:41 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:50:42 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating instance_info_cache with network_info: [{"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:50:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-a7211b55-7b3f-455b-b185-4e6432faf006" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:50:42 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:50:42 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:50:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:50:46 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:50:46 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:50:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=25.22292709350586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a7211b55-7b3f-455b-b185-4e6432faf006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 90bbd516-9124-423e-9bc8-2795c4e39c0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:47 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300232.9882903, a525e472-1e7b-40b5-a4b1-5ba8bae313c9 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:50:47 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] VM Stopped (Lifecycle Event)
Jul 25 15:50:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4d838846-1b3a-4472-9358-8a9e2edcb952 None None] [instance: a525e472-1e7b-40b5-a4b1-5ba8bae313c9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:50:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:50:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:50:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:49 user nova-compute[70869]: INFO nova.compute.manager [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Terminating instance
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-83954cd4-672d-491d-9f74-63241fb274bd req-e7a3f766-025e-4db0-b57f-2459fc939c73 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received event network-vif-unplugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-83954cd4-672d-491d-9f74-63241fb274bd req-e7a3f766-025e-4db0-b57f-2459fc939c73 service nova] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-83954cd4-672d-491d-9f74-63241fb274bd req-e7a3f766-025e-4db0-b57f-2459fc939c73 service nova] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-83954cd4-672d-491d-9f74-63241fb274bd req-e7a3f766-025e-4db0-b57f-2459fc939c73 service nova] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-83954cd4-672d-491d-9f74-63241fb274bd req-e7a3f766-025e-4db0-b57f-2459fc939c73 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] No waiting events found dispatching network-vif-unplugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-83954cd4-672d-491d-9f74-63241fb274bd req-e7a3f766-025e-4db0-b57f-2459fc939c73 service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received event network-vif-unplugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:50:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Instance destroyed successfully.
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.objects.instance [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lazy-loading 'resources' on Instance uuid a7211b55-7b3f-455b-b185-4e6432faf006 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2116910533',display_name='tempest-SnapshotDataIntegrityTests-server-2116910533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2116910533',id=29,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/oofr1ZxBQwScPmsOuwrv8RwvrNED/HxuubeCk2vqKoUhZf79IJOmqxHvko1JE4AmKT+5e1P2pw2S6yxrsF+zMixxoiGwblM7AqXTnaHJuajyEOOM2EcOTx/dDSS7Nng==',key_name='tempest-keypair-1493508955',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='824a047d86a145cfb65e2670b67f772e',ramdisk_id='',reservation_id='r-yuoszavx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1575215574',owner_user_name='tempest-SnapshotDataIntegrityTests-1575215574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ff326f1daa2470ba2a9825cba1a6cbd',uuid=a7211b55-7b3f-455b-b185-4e6432faf006,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Converting VIF {"id": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "address": "fa:16:3e:10:17:8d", "network": {"id": "cacef9c3-a484-4d84-bb86-741e35a384ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1634539728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824a047d86a145cfb65e2670b67f772e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839092bd-bc", "ovs_interfaceid": "839092bd-bc94-4891-b50c-a9cb6ae791f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=839092bd-bc94-4891-b50c-a9cb6ae791f4,network=Network(cacef9c3-a484-4d84-bb86-741e35a384ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839092bd-bc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG os_vif [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=839092bd-bc94-4891-b50c-a9cb6ae791f4,network=Network(cacef9c3-a484-4d84-bb86-741e35a384ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839092bd-bc') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap839092bd-bc, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:50:49 user nova-compute[70869]: INFO os_vif [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:17:8d,bridge_name='br-int',has_traffic_filtering=True,id=839092bd-bc94-4891-b50c-a9cb6ae791f4,network=Network(cacef9c3-a484-4d84-bb86-741e35a384ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839092bd-bc')
Jul 25 15:50:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Deleting instance files /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006_del
Jul 25 15:50:49 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Deletion of /opt/stack/data/nova/instances/a7211b55-7b3f-455b-b185-4e6432faf006_del complete
Jul 25 15:50:49 user nova-compute[70869]: INFO nova.compute.manager [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 25 15:50:49 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:50:49 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:50:50 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:50:50 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Took 0.87 seconds to deallocate network for instance.
Jul 25 15:50:50 user nova-compute[70869]: DEBUG nova.compute.manager [req-489c51fe-3729-4441-8bb7-47e4901c5e6e req-f7e71d3e-fec2-432c-9e89-52baaf16a26d service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received event network-vif-deleted-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:50 user nova-compute[70869]: INFO nova.compute.manager [req-489c51fe-3729-4441-8bb7-47e4901c5e6e req-f7e71d3e-fec2-432c-9e89-52baaf16a26d service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Neutron deleted interface 839092bd-bc94-4891-b50c-a9cb6ae791f4; detaching it from the instance and deleting it from the info cache
Jul 25 15:50:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-489c51fe-3729-4441-8bb7-47e4901c5e6e req-f7e71d3e-fec2-432c-9e89-52baaf16a26d service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:50:50 user nova-compute[70869]: DEBUG nova.compute.manager [req-489c51fe-3729-4441-8bb7-47e4901c5e6e req-f7e71d3e-fec2-432c-9e89-52baaf16a26d service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Detach interface failed, port_id=839092bd-bc94-4891-b50c-a9cb6ae791f4, reason: Instance a7211b55-7b3f-455b-b185-4e6432faf006 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:50:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:51 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:50:51 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:50:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:51 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Deleted allocations for instance a7211b55-7b3f-455b-b185-4e6432faf006
Jul 25 15:50:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a64ca6b-865b-4af7-b58f-224a8dbc232b tempest-SnapshotDataIntegrityTests-1575215574 tempest-SnapshotDataIntegrityTests-1575215574-project-member] Lock "a7211b55-7b3f-455b-b185-4e6432faf006" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.229s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-5f6a23dc-27c4-4648-9c39-889246dd42b7 req-cc636f07-a8a0-45bd-91f2-78ab9a2307cd service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received event network-vif-plugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:50:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5f6a23dc-27c4-4648-9c39-889246dd42b7 req-cc636f07-a8a0-45bd-91f2-78ab9a2307cd service nova] Acquiring lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:50:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5f6a23dc-27c4-4648-9c39-889246dd42b7 req-cc636f07-a8a0-45bd-91f2-78ab9a2307cd service nova] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:50:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5f6a23dc-27c4-4648-9c39-889246dd42b7 req-cc636f07-a8a0-45bd-91f2-78ab9a2307cd service nova] Lock "a7211b55-7b3f-455b-b185-4e6432faf006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:50:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-5f6a23dc-27c4-4648-9c39-889246dd42b7 req-cc636f07-a8a0-45bd-91f2-78ab9a2307cd service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] No waiting events found dispatching network-vif-plugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:50:51 user nova-compute[70869]: WARNING nova.compute.manager [req-5f6a23dc-27c4-4648-9c39-889246dd42b7 req-cc636f07-a8a0-45bd-91f2-78ab9a2307cd service nova] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Received unexpected event network-vif-plugged-839092bd-bc94-4891-b50c-a9cb6ae791f4 for instance with vm_state deleted and task_state None.
Jul 25 15:50:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:50:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-b3005287-425b-4193-bd82-9a900a739ee8 req-58b8f565-5a69-44c2-a682-26320fd2d2d5 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-changed-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:02 user nova-compute[70869]: DEBUG nova.compute.manager [req-b3005287-425b-4193-bd82-9a900a739ee8 req-58b8f565-5a69-44c2-a682-26320fd2d2d5 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Refreshing instance network info cache due to event network-changed-fc82c8ce-2156-4af8-97c8-5de08f051d07. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:51:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3005287-425b-4193-bd82-9a900a739ee8 req-58b8f565-5a69-44c2-a682-26320fd2d2d5 service nova] Acquiring lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:51:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3005287-425b-4193-bd82-9a900a739ee8 req-58b8f565-5a69-44c2-a682-26320fd2d2d5 service nova] Acquired lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:51:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-b3005287-425b-4193-bd82-9a900a739ee8 req-58b8f565-5a69-44c2-a682-26320fd2d2d5 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Refreshing network info cache for port fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:51:03 user nova-compute[70869]: DEBUG nova.network.neutron [req-b3005287-425b-4193-bd82-9a900a739ee8 req-58b8f565-5a69-44c2-a682-26320fd2d2d5 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updated VIF entry in instance network info cache for port fc82c8ce-2156-4af8-97c8-5de08f051d07. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:51:03 user nova-compute[70869]: DEBUG nova.network.neutron [req-b3005287-425b-4193-bd82-9a900a739ee8 req-58b8f565-5a69-44c2-a682-26320fd2d2d5 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updating instance_info_cache with network_info: [{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:51:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b3005287-425b-4193-bd82-9a900a739ee8 req-58b8f565-5a69-44c2-a682-26320fd2d2d5 service nova] Releasing lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:51:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:04 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300249.7918653, a7211b55-7b3f-455b-b185-4e6432faf006 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:51:04 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] VM Stopped (Lifecycle Event)
Jul 25 15:51:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d291b441-29ce-4461-adc4-6813cd1481fc None None] [instance: a7211b55-7b3f-455b-b185-4e6432faf006] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:51:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:07 user nova-compute[70869]: INFO nova.compute.manager [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Shelving
Jul 25 15:51:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-f396632e-daf2-434c-b12f-22f225c23bb7 req-be355b63-06fd-43b4-9971-fb2cb8487bf6 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-unplugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f396632e-daf2-434c-b12f-22f225c23bb7 req-be355b63-06fd-43b4-9971-fb2cb8487bf6 service nova] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f396632e-daf2-434c-b12f-22f225c23bb7 req-be355b63-06fd-43b4-9971-fb2cb8487bf6 service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f396632e-daf2-434c-b12f-22f225c23bb7 req-be355b63-06fd-43b4-9971-fb2cb8487bf6 service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-f396632e-daf2-434c-b12f-22f225c23bb7 req-be355b63-06fd-43b4-9971-fb2cb8487bf6 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] No waiting events found dispatching network-vif-unplugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:07 user nova-compute[70869]: WARNING nova.compute.manager [req-f396632e-daf2-434c-b12f-22f225c23bb7 req-be355b63-06fd-43b4-9971-fb2cb8487bf6 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received unexpected event network-vif-unplugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 for instance with vm_state active and task_state shelving.
Jul 25 15:51:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance destroyed successfully.
Jul 25 15:51:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Beginning cold snapshot process
Jul 25 15:51:08 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:51:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk /opt/stack/data/nova/instances/snapshots/tmp7ocavhel/c78edba0b6ee4e8eb295100305774f03 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk /opt/stack/data/nova/instances/snapshots/tmp7ocavhel/c78edba0b6ee4e8eb295100305774f03" returned: 0 in 1.049s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:09 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Snapshot extracted, beginning image upload
Jul 25 15:51:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f69e1728-acbc-4c2c-92e4-ced7a192b504 req-aefb165b-fc4a-49ba-b44e-6c031c8eb46a service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f69e1728-acbc-4c2c-92e4-ced7a192b504 req-aefb165b-fc4a-49ba-b44e-6c031c8eb46a service nova] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f69e1728-acbc-4c2c-92e4-ced7a192b504 req-aefb165b-fc4a-49ba-b44e-6c031c8eb46a service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f69e1728-acbc-4c2c-92e4-ced7a192b504 req-aefb165b-fc4a-49ba-b44e-6c031c8eb46a service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f69e1728-acbc-4c2c-92e4-ced7a192b504 req-aefb165b-fc4a-49ba-b44e-6c031c8eb46a service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] No waiting events found dispatching network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:09 user nova-compute[70869]: WARNING nova.compute.manager [req-f69e1728-acbc-4c2c-92e4-ced7a192b504 req-aefb165b-fc4a-49ba-b44e-6c031c8eb46a service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received unexpected event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 for instance with vm_state active and task_state shelving_image_uploading.
Jul 25 15:51:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-79352a24-092d-4aab-b7ef-19f6e0bdb4c6 req-379a29b7-4ff1-4a67-b089-1f35ff0ea8f7 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-79352a24-092d-4aab-b7ef-19f6e0bdb4c6 req-379a29b7-4ff1-4a67-b089-1f35ff0ea8f7 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing instance network info cache due to event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:51:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-79352a24-092d-4aab-b7ef-19f6e0bdb4c6 req-379a29b7-4ff1-4a67-b089-1f35ff0ea8f7 service nova] Acquiring lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:51:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-79352a24-092d-4aab-b7ef-19f6e0bdb4c6 req-379a29b7-4ff1-4a67-b089-1f35ff0ea8f7 service nova] Acquired lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:51:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-79352a24-092d-4aab-b7ef-19f6e0bdb4c6 req-379a29b7-4ff1-4a67-b089-1f35ff0ea8f7 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG nova.network.neutron [req-79352a24-092d-4aab-b7ef-19f6e0bdb4c6 req-379a29b7-4ff1-4a67-b089-1f35ff0ea8f7 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updated VIF entry in instance network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG nova.network.neutron [req-79352a24-092d-4aab-b7ef-19f6e0bdb4c6 req-379a29b7-4ff1-4a67-b089-1f35ff0ea8f7 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating instance_info_cache with network_info: [{"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-79352a24-092d-4aab-b7ef-19f6e0bdb4c6 req-379a29b7-4ff1-4a67-b089-1f35ff0ea8f7 service nova] Releasing lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:51:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Snapshot image upload complete
Jul 25 15:51:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:51:11 user nova-compute[70869]: INFO nova.compute.manager [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Shelve offloading
Jul 25 15:51:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance destroyed successfully.
Jul 25 15:51:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquired lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG nova.network.neutron [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:11 user nova-compute[70869]: INFO nova.compute.manager [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Detaching volume c1c4099f-6ff6-47d1-80b1-739fc52e6270
Jul 25 15:51:11 user nova-compute[70869]: INFO nova.virt.block_device [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Attempting to driver detach volume c1c4099f-6ff6-47d1-80b1-739fc52e6270 from mountpoint /dev/vdb
Jul 25 15:51:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Attempting to detach device vdb from instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:51:11 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:51:11 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:51:11 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:51:11 user nova-compute[70869]:   <serial>c1c4099f-6ff6-47d1-80b1-739fc52e6270</serial>
Jul 25 15:51:11 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:51:11 user nova-compute[70869]: </disk>
Jul 25 15:51:11 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:51:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully detached device vdb from instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 from the persistent domain config.
Jul 25 15:51:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:51:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:51:11 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:51:11 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:51:11 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:51:11 user nova-compute[70869]:   <serial>c1c4099f-6ff6-47d1-80b1-739fc52e6270</serial>
Jul 25 15:51:11 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:51:11 user nova-compute[70869]: </disk>
Jul 25 15:51:11 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300272.1535268, fc8f7a35-cb25-469d-ba79-832b8e6aaba0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:51:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully detached device vdb from instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 from the live domain config.
Jul 25 15:51:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVYrLuBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:51:12 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[08965f9f-58cf-4af3-9d0d-d6e04a183ee4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:51:12 user nova-compute[70869]: No targets found.
Jul 25 15:51:12 user nova-compute[70869]: iSNS:
Jul 25 15:51:12 user nova-compute[70869]: No targets found.
Jul 25 15:51:12 user nova-compute[70869]: STATIC:
Jul 25 15:51:12 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270
Jul 25 15:51:12 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:51:12 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:51:12 user nova-compute[70869]: FIRMWARE:
Jul 25 15:51:12 user nova-compute[70869]: No targets found.
Jul 25 15:51:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:51:12 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:51:12 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca224b5c-1c08-4061-86a8-2772eb459d14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc940b7e-ebbf-489e-bb2a-d46088a9645a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:51:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 (non-flash)
Jul 25 15:51:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe44324bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaadf7dc-e69b-43d4-a16a-69cf3216b6b9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bf1c60-a1ee-4c98-bb3c-9319af0da3e8]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ae3a8-b56e-4bf4-81e4-c57cc69d28cf]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[358bac27-9533-4b17-8a14-6ec4b5a773d1]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[27addfa9-8ee3-46f9-aeba-0867a9c46818]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[148407e5-2e1f-4c5e-aec4-70b57cf2bfd5]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270, portal: 172.16.0.220,3260]
Jul 25 15:51:12 user nova-compute[70869]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270, portal: 172.16.0.220,3260] successful.
Jul 25 15:51:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c4099f-6ff6-47d1-80b1-739fc52e6270 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1652ca6-a587-4b7b-a5d6-5e39003838e1]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] <== disconnect_volume: return (277ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG nova.network.neutron [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updating instance_info_cache with network_info: [{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Releasing lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-408061ac-76b5-4dc1-829f-9fd5dd5ef530 req-2b515389-4658-439f-85ff-706b71be3413 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-408061ac-76b5-4dc1-829f-9fd5dd5ef530 req-2b515389-4658-439f-85ff-706b71be3413 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing instance network info cache due to event network-changed-5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-408061ac-76b5-4dc1-829f-9fd5dd5ef530 req-2b515389-4658-439f-85ff-706b71be3413 service nova] Acquiring lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-408061ac-76b5-4dc1-829f-9fd5dd5ef530 req-2b515389-4658-439f-85ff-706b71be3413 service nova] Acquired lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:51:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-408061ac-76b5-4dc1-829f-9fd5dd5ef530 req-2b515389-4658-439f-85ff-706b71be3413 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Refreshing network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:51:13 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance destroyed successfully.
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'resources' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1065132208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1065132208',id=34,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF0ANaxRmVSCrp5TNnfTSdH57zDshrQQgFfIGImg+oIYvFUVNtzacx9oJXoT1aN4jpciZXHWYDXwvMLVFSDUIpzfr97MGx7HKNfVv5///H4sfG8nWsMJvtcelfDh6Ni+w==',key_name='tempest-keypair-1502387404',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:49:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-i3po3re1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member',shelved_at='2023-07-25T15:51:11.456918',shelved_host='user',shelved_image_id='5d90df0a-9fa8-460b-8075-0ec7398c28a0'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=90bbd516-9124-423e-9bc8-2795c4e39c0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG os_vif [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc82c8ce-21, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-665023a9-1b0f-407a-a208-95ab3da19d42 req-74a213e1-3378-48b6-b48b-bb3c6fae3c8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-changed-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-665023a9-1b0f-407a-a208-95ab3da19d42 req-74a213e1-3378-48b6-b48b-bb3c6fae3c8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Refreshing instance network info cache due to event network-changed-fc82c8ce-2156-4af8-97c8-5de08f051d07. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-665023a9-1b0f-407a-a208-95ab3da19d42 req-74a213e1-3378-48b6-b48b-bb3c6fae3c8c service nova] Acquiring lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-665023a9-1b0f-407a-a208-95ab3da19d42 req-74a213e1-3378-48b6-b48b-bb3c6fae3c8c service nova] Acquired lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-665023a9-1b0f-407a-a208-95ab3da19d42 req-74a213e1-3378-48b6-b48b-bb3c6fae3c8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Refreshing network info cache for port fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:51:13 user nova-compute[70869]: INFO os_vif [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21')
Jul 25 15:51:13 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Deleting instance files /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e_del
Jul 25 15:51:13 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Deletion of /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e_del complete
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-408061ac-76b5-4dc1-829f-9fd5dd5ef530 req-2b515389-4658-439f-85ff-706b71be3413 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updated VIF entry in instance network info cache for port 5cac5d10-cbcd-48d7-b476-268d6d757071. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-408061ac-76b5-4dc1-829f-9fd5dd5ef530 req-2b515389-4658-439f-85ff-706b71be3413 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating instance_info_cache with network_info: [{"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-408061ac-76b5-4dc1-829f-9fd5dd5ef530 req-2b515389-4658-439f-85ff-706b71be3413 service nova] Releasing lock "refresh_cache-fc8f7a35-cb25-469d-ba79-832b8e6aaba0" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'flavor' on Instance uuid fc8f7a35-cb25-469d-ba79-832b8e6aaba0 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4c5f45a1-76ca-47d4-8159-dd2dcf39f7b5 tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:13 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Deleted allocations for instance 90bbd516-9124-423e-9bc8-2795c4e39c0e
Jul 25 15:51:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'numa_topology' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-665023a9-1b0f-407a-a208-95ab3da19d42 req-74a213e1-3378-48b6-b48b-bb3c6fae3c8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updated VIF entry in instance network info cache for port fc82c8ce-2156-4af8-97c8-5de08f051d07. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG nova.network.neutron [req-665023a9-1b0f-407a-a208-95ab3da19d42 req-74a213e1-3378-48b6-b48b-bb3c6fae3c8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updating instance_info_cache with network_info: [{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-665023a9-1b0f-407a-a208-95ab3da19d42 req-74a213e1-3378-48b6-b48b-bb3c6fae3c8c service nova] Releasing lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:51:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-670a9eda-f21b-438d-8bc3-0a215515b6fc tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.451s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:22 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300267.821288, 90bbd516-9124-423e-9bc8-2795c4e39c0e => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:51:22 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] VM Stopped (Lifecycle Event)
Jul 25 15:51:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ed93d678-6200-4854-96e9-1f69337abb11 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:51:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:22 user nova-compute[70869]: INFO nova.compute.manager [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Terminating instance
Jul 25 15:51:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-dfe209b0-cb48-4052-8ccf-54b5592c3bc8 req-fc99e5d1-db4c-4388-b945-688f28106d26 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received event network-vif-unplugged-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dfe209b0-cb48-4052-8ccf-54b5592c3bc8 req-fc99e5d1-db4c-4388-b945-688f28106d26 service nova] Acquiring lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dfe209b0-cb48-4052-8ccf-54b5592c3bc8 req-fc99e5d1-db4c-4388-b945-688f28106d26 service nova] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dfe209b0-cb48-4052-8ccf-54b5592c3bc8 req-fc99e5d1-db4c-4388-b945-688f28106d26 service nova] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-dfe209b0-cb48-4052-8ccf-54b5592c3bc8 req-fc99e5d1-db4c-4388-b945-688f28106d26 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] No waiting events found dispatching network-vif-unplugged-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-dfe209b0-cb48-4052-8ccf-54b5592c3bc8 req-fc99e5d1-db4c-4388-b945-688f28106d26 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received event network-vif-unplugged-20104704-4c49-4860-95d3-64fe55afc3b3 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:51:23 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Instance destroyed successfully.
Jul 25 15:51:23 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lazy-loading 'resources' on Instance uuid 5ce85315-be2f-4be3-953f-ed7b5d4685d6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2040073500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2040073500',id=3,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3735c3192f424a8abee7c1874609f005',ramdisk_id='',reservation_id='r-xexi98s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-508290498',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:33:41Z,user_data=None,user_id='02dfa618b8fc4b06b5e396b7da9e8443',uuid=5ce85315-be2f-4be3-953f-ed7b5d4685d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converting VIF {"id": "20104704-4c49-4860-95d3-64fe55afc3b3", "address": "fa:16:3e:7e:99:b6", "network": {"id": "7bf215ea-a43d-49f9-8334-c98b6cb53166", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1528197474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3735c3192f424a8abee7c1874609f005", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20104704-4c", "ovs_interfaceid": "20104704-4c49-4860-95d3-64fe55afc3b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:99:b6,bridge_name='br-int',has_traffic_filtering=True,id=20104704-4c49-4860-95d3-64fe55afc3b3,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20104704-4c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG os_vif [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:99:b6,bridge_name='br-int',has_traffic_filtering=True,id=20104704-4c49-4860-95d3-64fe55afc3b3,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20104704-4c') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20104704-4c, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:23 user nova-compute[70869]: INFO os_vif [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:99:b6,bridge_name='br-int',has_traffic_filtering=True,id=20104704-4c49-4860-95d3-64fe55afc3b3,network=Network(7bf215ea-a43d-49f9-8334-c98b6cb53166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20104704-4c')
Jul 25 15:51:23 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Deleting instance files /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6_del
Jul 25 15:51:23 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Deletion of /opt/stack/data/nova/instances/5ce85315-be2f-4be3-953f-ed7b5d4685d6_del complete
Jul 25 15:51:23 user nova-compute[70869]: INFO nova.compute.manager [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Took 0.99 seconds to destroy the instance on the hypervisor.
Jul 25 15:51:23 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:51:23 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:51:24 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:51:24 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Took 0.48 seconds to deallocate network for instance.
Jul 25 15:51:24 user nova-compute[70869]: DEBUG nova.compute.manager [req-84457709-d95e-4b25-83d5-d3c550a00196 req-d1b7debd-428e-4ada-bd56-fe9fbdb25c41 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received event network-vif-deleted-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:24 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:51:24 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:51:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:24 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Deleted allocations for instance 5ce85315-be2f-4be3-953f-ed7b5d4685d6
Jul 25 15:51:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3243945c-ae14-40df-bcba-2f1a3c372124 tempest-ServerBootFromVolumeStableRescueTest-508290498 tempest-ServerBootFromVolumeStableRescueTest-508290498-project-member] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.920s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-d0425b32-0f9d-4271-90e8-a72ed73c4f7b req-88051296-f4a5-4a4b-b7d5-7db20fb82208 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received event network-vif-plugged-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d0425b32-0f9d-4271-90e8-a72ed73c4f7b req-88051296-f4a5-4a4b-b7d5-7db20fb82208 service nova] Acquiring lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d0425b32-0f9d-4271-90e8-a72ed73c4f7b req-88051296-f4a5-4a4b-b7d5-7db20fb82208 service nova] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d0425b32-0f9d-4271-90e8-a72ed73c4f7b req-88051296-f4a5-4a4b-b7d5-7db20fb82208 service nova] Lock "5ce85315-be2f-4be3-953f-ed7b5d4685d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-d0425b32-0f9d-4271-90e8-a72ed73c4f7b req-88051296-f4a5-4a4b-b7d5-7db20fb82208 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] No waiting events found dispatching network-vif-plugged-20104704-4c49-4860-95d3-64fe55afc3b3 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:25 user nova-compute[70869]: WARNING nova.compute.manager [req-d0425b32-0f9d-4271-90e8-a72ed73c4f7b req-88051296-f4a5-4a4b-b7d5-7db20fb82208 service nova] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Received unexpected event network-vif-plugged-20104704-4c49-4860-95d3-64fe55afc3b3 for instance with vm_state deleted and task_state None.
Jul 25 15:51:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:38 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300283.679412, 5ce85315-be2f-4be3-953f-ed7b5d4685d6 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:51:38 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] VM Stopped (Lifecycle Event)
Jul 25 15:51:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-31526127-57b7-4cc9-aeb7-2824c6ebd62b None None] [instance: 5ce85315-be2f-4be3-953f-ed7b5d4685d6] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:51:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:41 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquiring lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquiring lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:43 user nova-compute[70869]: INFO nova.compute.manager [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Terminating instance
Jul 25 15:51:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-812d7e50-b891-4185-9439-73000f547755 req-8d3209cb-e51c-4ad4-b605-32be0e9c4898 service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received event network-vif-unplugged-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-812d7e50-b891-4185-9439-73000f547755 req-8d3209cb-e51c-4ad4-b605-32be0e9c4898 service nova] Acquiring lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-812d7e50-b891-4185-9439-73000f547755 req-8d3209cb-e51c-4ad4-b605-32be0e9c4898 service nova] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-812d7e50-b891-4185-9439-73000f547755 req-8d3209cb-e51c-4ad4-b605-32be0e9c4898 service nova] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-812d7e50-b891-4185-9439-73000f547755 req-8d3209cb-e51c-4ad4-b605-32be0e9c4898 service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] No waiting events found dispatching network-vif-unplugged-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-812d7e50-b891-4185-9439-73000f547755 req-8d3209cb-e51c-4ad4-b605-32be0e9c4898 service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received event network-vif-unplugged-52a923e8-8329-483f-8128-b3da4ebf69e9 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 15:51:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Instance destroyed successfully.
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lazy-loading 'resources' on Instance uuid 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1895126806',display_name='tempest-VolumesNegativeTest-instance-1895126806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1895126806',id=35,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:50:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b352631168e845c8902d50249f4c81a0',ramdisk_id='',reservation_id='r-b788r2xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1028621959',owner_user_name='tempest-VolumesNegativeTest-1028621959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:50:00Z,user_data=None,user_id='0e52b9a4789f4c3e93d2c3857ac8cce2',uuid=4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Converting VIF {"id": "52a923e8-8329-483f-8128-b3da4ebf69e9", "address": "fa:16:3e:e1:5d:32", "network": {"id": "75c29593-ba52-4032-bbc1-4efe36137b40", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "357c5a6c8220419bbbd4cf604f820a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52a923e8-83", "ovs_interfaceid": "52a923e8-8329-483f-8128-b3da4ebf69e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5d:32,bridge_name='br-int',has_traffic_filtering=True,id=52a923e8-8329-483f-8128-b3da4ebf69e9,network=Network(75c29593-ba52-4032-bbc1-4efe36137b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a923e8-83') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG os_vif [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5d:32,bridge_name='br-int',has_traffic_filtering=True,id=52a923e8-8329-483f-8128-b3da4ebf69e9,network=Network(75c29593-ba52-4032-bbc1-4efe36137b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a923e8-83') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52a923e8-83, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:51:44 user nova-compute[70869]: INFO os_vif [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:5d:32,bridge_name='br-int',has_traffic_filtering=True,id=52a923e8-8329-483f-8128-b3da4ebf69e9,network=Network(75c29593-ba52-4032-bbc1-4efe36137b40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52a923e8-83')
Jul 25 15:51:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Deleting instance files /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9_del
Jul 25 15:51:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Deletion of /opt/stack/data/nova/instances/4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9_del complete
Jul 25 15:51:44 user nova-compute[70869]: INFO nova.compute.manager [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Took 0.66 seconds to destroy the instance on the hypervisor.
Jul 25 15:51:44 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:51:44 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Took 0.52 seconds to deallocate network for instance.
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-7c8afa58-eda0-44b0-a97e-c8e12cda4509 req-08ed0e36-8ef0-491d-974f-b1e59becd0af service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received event network-vif-deleted-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:44 user nova-compute[70869]: INFO nova.compute.manager [req-7c8afa58-eda0-44b0-a97e-c8e12cda4509 req-08ed0e36-8ef0-491d-974f-b1e59becd0af service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Neutron deleted interface 52a923e8-8329-483f-8128-b3da4ebf69e9; detaching it from the instance and deleting it from the info cache
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.network.neutron [req-7c8afa58-eda0-44b0-a97e-c8e12cda4509 req-08ed0e36-8ef0-491d-974f-b1e59becd0af service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-7c8afa58-eda0-44b0-a97e-c8e12cda4509 req-08ed0e36-8ef0-491d-974f-b1e59becd0af service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Detach interface failed, port_id=52a923e8-8329-483f-8128-b3da4ebf69e9, reason: Instance 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:51:44 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.234s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:51:45 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Deleted allocations for instance 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d39ae8b1-2047-4b4c-a83c-d21121fd9cbb tempest-VolumesNegativeTest-1028621959 tempest-VolumesNegativeTest-1028621959-project-member] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.649s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-d3a39f87-37cd-4bd3-b61a-242c3d2467d8 req-dc37f604-858f-43d7-b9cb-4457234814aa service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received event network-vif-plugged-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d3a39f87-37cd-4bd3-b61a-242c3d2467d8 req-dc37f604-858f-43d7-b9cb-4457234814aa service nova] Acquiring lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d3a39f87-37cd-4bd3-b61a-242c3d2467d8 req-dc37f604-858f-43d7-b9cb-4457234814aa service nova] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d3a39f87-37cd-4bd3-b61a-242c3d2467d8 req-dc37f604-858f-43d7-b9cb-4457234814aa service nova] Lock "4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-d3a39f87-37cd-4bd3-b61a-242c3d2467d8 req-dc37f604-858f-43d7-b9cb-4457234814aa service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] No waiting events found dispatching network-vif-plugged-52a923e8-8329-483f-8128-b3da4ebf69e9 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:45 user nova-compute[70869]: WARNING nova.compute.manager [req-d3a39f87-37cd-4bd3-b61a-242c3d2467d8 req-dc37f604-858f-43d7-b9cb-4457234814aa service nova] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Received unexpected event network-vif-plugged-52a923e8-8329-483f-8128-b3da4ebf69e9 for instance with vm_state deleted and task_state None.
Jul 25 15:51:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:46 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:51:46 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:51:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8230MB free_disk=25.381053924560547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:51:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:52 user nova-compute[70869]: INFO nova.compute.manager [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Rescuing
Jul 25 15:51:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:51:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquired lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:51:52 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:51:52 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updating instance_info_cache with network_info: [{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:51:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Releasing lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:51:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:51:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-6b379eba-c271-49e9-9ef9-a15ec8c6b7f3 req-e3f1d265-942b-469b-81c1-ff4a0defbf8e service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6b379eba-c271-49e9-9ef9-a15ec8c6b7f3 req-e3f1d265-942b-469b-81c1-ff4a0defbf8e service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6b379eba-c271-49e9-9ef9-a15ec8c6b7f3 req-e3f1d265-942b-469b-81c1-ff4a0defbf8e service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6b379eba-c271-49e9-9ef9-a15ec8c6b7f3 req-e3f1d265-942b-469b-81c1-ff4a0defbf8e service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-6b379eba-c271-49e9-9ef9-a15ec8c6b7f3 req-e3f1d265-942b-469b-81c1-ff4a0defbf8e service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:53 user nova-compute[70869]: WARNING nova.compute.manager [req-6b379eba-c271-49e9-9ef9-a15ec8c6b7f3 req-e3f1d265-942b-469b-81c1-ff4a0defbf8e service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state active and task_state rescuing.
Jul 25 15:51:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Instance destroyed successfully.
Jul 25 15:51:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Attempting rescue
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70869) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Instance directory exists: not creating {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 15:51:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Creating image(s)
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.191s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.rescue {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.rescue" returned: 0 in 0.059s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'migration_context' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Start _get_guest_xml network_info=[{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "vif_mac": "fa:16:3e:99:ff:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'resources' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'numa_topology' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:53 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:51:53 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055914467',display_name='tempest-ServerRescueNegativeTestJSON-server-2055914467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055914467',id=31,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-igielsyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:47:15Z,user_data=None,user_id='2cee3181b38f451a929907b0250f7ae0',uuid=e1ff49de-2dee-476c-8bf1-b70e64fe991e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "vif_mac": "fa:16:3e:99:ff:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "vif_mac": "fa:16:3e:99:ff:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:ff:ec,bridge_name='br-int',has_traffic_filtering=True,id=efe49064-97de-4484-9655-e582f8eac530,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe49064-97') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'pci_devices' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:51:53 user nova-compute[70869]:   <uuid>e1ff49de-2dee-476c-8bf1-b70e64fe991e</uuid>
Jul 25 15:51:53 user nova-compute[70869]:   <name>instance-0000001f</name>
Jul 25 15:51:53 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:51:53 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:51:53 user nova-compute[70869]:   <metadata>
Jul 25 15:51:53 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:51:53 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:51:53 user nova-compute[70869]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2055914467</nova:name>
Jul 25 15:51:53 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:51:53</nova:creationTime>
Jul 25 15:51:53 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:51:53 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:51:53 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:51:53 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:51:53 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:51:53 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:51:53 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:51:53 user nova-compute[70869]:       <nova:owner>
Jul 25 15:51:53 user nova-compute[70869]:         <nova:user uuid="2cee3181b38f451a929907b0250f7ae0">tempest-ServerRescueNegativeTestJSON-2116380302-project-member</nova:user>
Jul 25 15:51:53 user nova-compute[70869]:         <nova:project uuid="40a65674a8194f93a976d52353da0c39">tempest-ServerRescueNegativeTestJSON-2116380302</nova:project>
Jul 25 15:51:53 user nova-compute[70869]:       </nova:owner>
Jul 25 15:51:53 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:51:53 user nova-compute[70869]:       <nova:ports>
Jul 25 15:51:53 user nova-compute[70869]:         <nova:port uuid="efe49064-97de-4484-9655-e582f8eac530">
Jul 25 15:51:53 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 25 15:51:53 user nova-compute[70869]:         </nova:port>
Jul 25 15:51:53 user nova-compute[70869]:       </nova:ports>
Jul 25 15:51:53 user nova-compute[70869]:     </nova:instance>
Jul 25 15:51:53 user nova-compute[70869]:   </metadata>
Jul 25 15:51:53 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:51:53 user nova-compute[70869]:     <system>
Jul 25 15:51:53 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:51:53 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:51:53 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:51:53 user nova-compute[70869]:       <entry name="serial">e1ff49de-2dee-476c-8bf1-b70e64fe991e</entry>
Jul 25 15:51:53 user nova-compute[70869]:       <entry name="uuid">e1ff49de-2dee-476c-8bf1-b70e64fe991e</entry>
Jul 25 15:51:53 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:51:53 user nova-compute[70869]:     </system>
Jul 25 15:51:53 user nova-compute[70869]:   </sysinfo>
Jul 25 15:51:53 user nova-compute[70869]:   <os>
Jul 25 15:51:53 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:51:53 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:51:53 user nova-compute[70869]:   </os>
Jul 25 15:51:53 user nova-compute[70869]:   <features>
Jul 25 15:51:53 user nova-compute[70869]:     <acpi/>
Jul 25 15:51:53 user nova-compute[70869]:     <apic/>
Jul 25 15:51:53 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:51:53 user nova-compute[70869]:   </features>
Jul 25 15:51:53 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:51:53 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:51:53 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:51:53 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:51:53 user nova-compute[70869]:   </clock>
Jul 25 15:51:53 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:51:53 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:51:53 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:51:53 user nova-compute[70869]:   </cpu>
Jul 25 15:51:53 user nova-compute[70869]:   <devices>
Jul 25 15:51:53 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:51:53 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:51:53 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.rescue"/>
Jul 25 15:51:53 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:51:53 user nova-compute[70869]:     </disk>
Jul 25 15:51:53 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:51:53 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:51:53 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk"/>
Jul 25 15:51:53 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:51:53 user nova-compute[70869]:     </disk>
Jul 25 15:51:53 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:51:53 user nova-compute[70869]:       <mac address="fa:16:3e:99:ff:ec"/>
Jul 25 15:51:53 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:51:53 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:51:53 user nova-compute[70869]:       <target dev="tapefe49064-97"/>
Jul 25 15:51:53 user nova-compute[70869]:     </interface>
Jul 25 15:51:53 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:51:53 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/console.log" append="off"/>
Jul 25 15:51:53 user nova-compute[70869]:     </serial>
Jul 25 15:51:53 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:51:53 user nova-compute[70869]:     <video>
Jul 25 15:51:53 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:51:53 user nova-compute[70869]:     </video>
Jul 25 15:51:53 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:51:53 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:51:53 user nova-compute[70869]:     </rng>
Jul 25 15:51:53 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:51:53 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:51:53 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:51:53 user nova-compute[70869]:     </memballoon>
Jul 25 15:51:53 user nova-compute[70869]:   </devices>
Jul 25 15:51:53 user nova-compute[70869]: </domain>
Jul 25 15:51:53 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:51:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Instance destroyed successfully.
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No VIF found with MAC fa:16:3e:99:ff:ec, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:55 user nova-compute[70869]: WARNING nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state active and task_state rescuing.
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:55 user nova-compute[70869]: WARNING nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state active and task_state rescuing.
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:55 user nova-compute[70869]: WARNING nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state active and task_state rescuing.
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:55 user nova-compute[70869]: WARNING nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state active and task_state rescuing.
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:55 user nova-compute[70869]: WARNING nova.compute.manager [req-066a92c8-c6da-4d09-a203-f18fd9c8d137 req-f9117446-2402-490b-b888-e4e38fca8907 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state active and task_state rescuing.
Jul 25 15:51:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:57 user nova-compute[70869]: WARNING nova.compute.manager [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state active and task_state rescuing.
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:51:57 user nova-compute[70869]: WARNING nova.compute.manager [req-be8cc5a3-9761-4284-afd7-19aec6c12b0f req-3e0e299f-66a8-42e1-9da0-ac6d32d28847 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state active and task_state rescuing.
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for e1ff49de-2dee-476c-8bf1-b70e64fe991e due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300317.2277977, e1ff49de-2dee-476c-8bf1-b70e64fe991e => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:51:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] VM Resumed (Lifecycle Event)
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5f0faaab-62ef-438f-9fa9-8f3abadd08ad tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:51:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300317.2345104, e1ff49de-2dee-476c-8bf1-b70e64fe991e => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:51:57 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] VM Started (Lifecycle Event)
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:51:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:51:59 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300304.0512364, 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:51:59 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] VM Stopped (Lifecycle Event)
Jul 25 15:51:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-643a6f0c-05db-4b5e-8534-84a7cf52af99 None None] [instance: 4e92fa9f-77c0-4b95-b16d-ad7eef36f3d9] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:51:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:51:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:06 user nova-compute[70869]: INFO nova.compute.manager [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Terminating instance
Jul 25 15:52:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-009d915d-0f75-4c5c-b890-29777ec1c9e2 req-f3d2d33f-a214-495e-aca2-5e2d824fd122 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-unplugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-009d915d-0f75-4c5c-b890-29777ec1c9e2 req-f3d2d33f-a214-495e-aca2-5e2d824fd122 service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-009d915d-0f75-4c5c-b890-29777ec1c9e2 req-f3d2d33f-a214-495e-aca2-5e2d824fd122 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-009d915d-0f75-4c5c-b890-29777ec1c9e2 req-f3d2d33f-a214-495e-aca2-5e2d824fd122 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-009d915d-0f75-4c5c-b890-29777ec1c9e2 req-f3d2d33f-a214-495e-aca2-5e2d824fd122 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-unplugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-009d915d-0f75-4c5c-b890-29777ec1c9e2 req-f3d2d33f-a214-495e-aca2-5e2d824fd122 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-unplugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Instance destroyed successfully.
Jul 25 15:52:07 user nova-compute[70869]: DEBUG nova.objects.instance [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lazy-loading 'resources' on Instance uuid fc8f7a35-cb25-469d-ba79-832b8e6aaba0 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-178917315',display_name='tempest-TestMinimumBasicScenario-server-178917315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-178917315',id=33,image_ref='f94a612b-4562-47e5-9d51-2797f07a0a88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfYlMxGcH3fEmHTIEIEtyNsmsxO6pJzoTkgLBbTfVtbM/zV5roNnGTBokhbDaHb3PSlSPU/m6tYJ63tM3Ek+WbAfE7C8Yu/nDd1qrpgtx826Ny/rWvLkUYqxBKNOavWcA==',key_name='tempest-TestMinimumBasicScenario-776375289',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:47:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c07ad06e29c4d2dbe409fa13979b81b',ramdisk_id='',reservation_id='r-50otbupw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f94a612b-4562-47e5-9d51-2797f07a0a88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1773990321',owner_user_name='tempest-TestMinimumBasicScenario-1773990321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:49:26Z,user_data=None,user_id='a905cee33a204704937a0224b3e6fab1',uuid=fc8f7a35-cb25-469d-ba79-832b8e6aaba0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converting VIF {"id": "5cac5d10-cbcd-48d7-b476-268d6d757071", "address": "fa:16:3e:95:c6:94", "network": {"id": "f447a4cf-7b63-40be-867c-c2f4bd50a3f2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559413231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c07ad06e29c4d2dbe409fa13979b81b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cac5d10-cb", "ovs_interfaceid": "5cac5d10-cbcd-48d7-b476-268d6d757071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:c6:94,bridge_name='br-int',has_traffic_filtering=True,id=5cac5d10-cbcd-48d7-b476-268d6d757071,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cac5d10-cb') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG os_vif [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:c6:94,bridge_name='br-int',has_traffic_filtering=True,id=5cac5d10-cbcd-48d7-b476-268d6d757071,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cac5d10-cb') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cac5d10-cb, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:07 user nova-compute[70869]: INFO os_vif [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:c6:94,bridge_name='br-int',has_traffic_filtering=True,id=5cac5d10-cbcd-48d7-b476-268d6d757071,network=Network(f447a4cf-7b63-40be-867c-c2f4bd50a3f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cac5d10-cb')
Jul 25 15:52:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Deleting instance files /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0_del
Jul 25 15:52:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Deletion of /opt/stack/data/nova/instances/fc8f7a35-cb25-469d-ba79-832b8e6aaba0_del complete
Jul 25 15:52:07 user nova-compute[70869]: INFO nova.compute.manager [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 25 15:52:07 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:52:07 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:52:08 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Took 0.99 seconds to deallocate network for instance.
Jul 25 15:52:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-7551f026-c4d5-4345-961d-5ab0a10a5f40 req-cbfc0ac9-41aa-4b99-a772-a5d36147a5b7 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-deleted-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:08 user nova-compute[70869]: INFO nova.compute.manager [req-7551f026-c4d5-4345-961d-5ab0a10a5f40 req-cbfc0ac9-41aa-4b99-a772-a5d36147a5b7 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Neutron deleted interface 5cac5d10-cbcd-48d7-b476-268d6d757071; detaching it from the instance and deleting it from the info cache
Jul 25 15:52:08 user nova-compute[70869]: DEBUG nova.network.neutron [req-7551f026-c4d5-4345-961d-5ab0a10a5f40 req-cbfc0ac9-41aa-4b99-a772-a5d36147a5b7 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-7551f026-c4d5-4345-961d-5ab0a10a5f40 req-cbfc0ac9-41aa-4b99-a772-a5d36147a5b7 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Detach interface failed, port_id=5cac5d10-cbcd-48d7-b476-268d6d757071, reason: Instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:52:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:08 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Deleted allocations for instance fc8f7a35-cb25-469d-ba79-832b8e6aaba0
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:09 user nova-compute[70869]: WARNING nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state deleted and task_state None.
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:09 user nova-compute[70869]: WARNING nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state deleted and task_state None.
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:09 user nova-compute[70869]: WARNING nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state deleted and task_state None.
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-unplugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-unplugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:09 user nova-compute[70869]: WARNING nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-unplugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state deleted and task_state None.
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Acquiring lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] No waiting events found dispatching network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:09 user nova-compute[70869]: WARNING nova.compute.manager [req-f58b48e7-a3eb-4e64-aefd-ec8fdca63b59 req-468db432-cf43-429b-a769-b4d7589bb025 service nova] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Received unexpected event network-vif-plugged-5cac5d10-cbcd-48d7-b476-268d6d757071 for instance with vm_state deleted and task_state None.
Jul 25 15:52:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-44378d6a-70a2-47ed-a322-2373c8f3537c tempest-TestMinimumBasicScenario-1773990321 tempest-TestMinimumBasicScenario-1773990321-project-member] Lock "fc8f7a35-cb25-469d-ba79-832b8e6aaba0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.381s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:11 user nova-compute[70869]: INFO nova.compute.manager [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Terminating instance
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-fbfbadd6-8bc5-402c-8a5a-b91c5c07d92c req-4a66c47b-3b67-4e6a-a49f-ef850f951b1a service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-vif-unplugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fbfbadd6-8bc5-402c-8a5a-b91c5c07d92c req-4a66c47b-3b67-4e6a-a49f-ef850f951b1a service nova] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fbfbadd6-8bc5-402c-8a5a-b91c5c07d92c req-4a66c47b-3b67-4e6a-a49f-ef850f951b1a service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fbfbadd6-8bc5-402c-8a5a-b91c5c07d92c req-4a66c47b-3b67-4e6a-a49f-ef850f951b1a service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-fbfbadd6-8bc5-402c-8a5a-b91c5c07d92c req-4a66c47b-3b67-4e6a-a49f-ef850f951b1a service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] No waiting events found dispatching network-vif-unplugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-fbfbadd6-8bc5-402c-8a5a-b91c5c07d92c req-4a66c47b-3b67-4e6a-a49f-ef850f951b1a service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-vif-unplugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Instance destroyed successfully.
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lazy-loading 'resources' on Instance uuid 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1275707219',display_name='tempest-VolumesActionsTest-instance-1275707219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1275707219',id=36,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cabdedcca7cb44c9b3c76177e53006bc',ramdisk_id='',reservation_id='r-0v3eap0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1960082272',owner_user_name='tempest-VolumesActionsTest-1960082272-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:50:16Z,user_data=None,user_id='e0c24788ba1e448095d2d5d7d84b6ca3',uuid=336e00d3-5d9b-4450-9e7d-ef03bc0e3da2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Converting VIF {"id": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "address": "fa:16:3e:aa:4d:a4", "network": {"id": "82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60898826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cabdedcca7cb44c9b3c76177e53006bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8de4493-31", "ovs_interfaceid": "f8de4493-31f5-42c7-9bf5-a4ff262308ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4d:a4,bridge_name='br-int',has_traffic_filtering=True,id=f8de4493-31f5-42c7-9bf5-a4ff262308ee,network=Network(82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8de4493-31') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG os_vif [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4d:a4,bridge_name='br-int',has_traffic_filtering=True,id=f8de4493-31f5-42c7-9bf5-a4ff262308ee,network=Network(82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8de4493-31') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8de4493-31, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:52:11 user nova-compute[70869]: INFO os_vif [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4d:a4,bridge_name='br-int',has_traffic_filtering=True,id=f8de4493-31f5-42c7-9bf5-a4ff262308ee,network=Network(82ac4b8a-41a1-4f72-bf24-c13fc4aa05b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8de4493-31')
Jul 25 15:52:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Deleting instance files /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2_del
Jul 25 15:52:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Deletion of /opt/stack/data/nova/instances/336e00d3-5d9b-4450-9e7d-ef03bc0e3da2_del complete
Jul 25 15:52:11 user nova-compute[70869]: INFO nova.compute.manager [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 25 15:52:11 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:52:11 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:52:12 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Took 0.52 seconds to deallocate network for instance.
Jul 25 15:52:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-08e7ba8e-0432-4d83-9985-c2d1aadc5daf req-17cb858b-37e2-487d-8018-453a778733b8 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-vif-deleted-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:52:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:12 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Deleted allocations for instance 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2
Jul 25 15:52:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d2a171cc-210b-4478-a5c5-c87f927b94af tempest-VolumesActionsTest-1960082272 tempest-VolumesActionsTest-1960082272-project-member] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.727s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] No waiting events found dispatching network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:13 user nova-compute[70869]: WARNING nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received unexpected event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee for instance with vm_state deleted and task_state None.
Jul 25 15:52:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] No waiting events found dispatching network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:13 user nova-compute[70869]: WARNING nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received unexpected event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee for instance with vm_state deleted and task_state None.
Jul 25 15:52:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] No waiting events found dispatching network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:13 user nova-compute[70869]: WARNING nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received unexpected event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee for instance with vm_state deleted and task_state None.
Jul 25 15:52:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Acquiring lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] Lock "336e00d3-5d9b-4450-9e7d-ef03bc0e3da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] No waiting events found dispatching network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:52:13 user nova-compute[70869]: WARNING nova.compute.manager [req-5d9d32ab-fd3d-43bf-8a99-dd9266d977c6 req-747b65f8-2e0c-4be1-9f55-f1dfb609a8e1 service nova] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Received unexpected event network-vif-plugged-f8de4493-31f5-42c7-9bf5-a4ff262308ee for instance with vm_state deleted and task_state None.
Jul 25 15:52:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:22 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300327.4705448, fc8f7a35-cb25-469d-ba79-832b8e6aaba0 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:52:22 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] VM Stopped (Lifecycle Event)
Jul 25 15:52:22 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8b95158d-2383-4e52-9f79-04e7878c9849 None None] [instance: fc8f7a35-cb25-469d-ba79-832b8e6aaba0] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:52:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:26 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300331.8515007, 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:52:26 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] VM Stopped (Lifecycle Event)
Jul 25 15:52:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7af2edcb-61e6-4b6f-9d7b-ceece8f4afac None None] [instance: 336e00d3-5d9b-4450-9e7d-ef03bc0e3da2] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:52:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:44 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:44 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:52:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:52:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:52:46 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:52:46 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8537MB free_disk=25.42397689819336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing inventories for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating ProviderTree inventory for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing aggregate associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, aggregates: None {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:46 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing trait associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41 {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 15:52:47 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:52:47 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:52:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:52:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:52:47 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances with incomplete migration  {{(pid=70869) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updating instance_info_cache with network_info: [{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:52:49 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:52:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:52:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:52:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:52:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:52:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:52:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:55 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:52:55 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 15:52:55 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] There are 0 instances to clean {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 15:52:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:52:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:52:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:52:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:52:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:52:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:00 user nova-compute[70869]: INFO nova.compute.manager [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Unshelving
Jul 25 15:53:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:00 user nova-compute[70869]: DEBUG nova.objects.instance [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'pci_requests' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:53:00 user nova-compute[70869]: DEBUG nova.objects.instance [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'numa_topology' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:53:00 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:53:00 user nova-compute[70869]: INFO nova.compute.claims [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Claim successful on node user
Jul 25 15:53:00 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:53:00 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:53:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:01 user nova-compute[70869]: INFO nova.network.neutron [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updating port fc82c8ce-2156-4af8-97c8-5de08f051d07 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 25 15:53:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:53:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquired lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:53:01 user nova-compute[70869]: DEBUG nova.network.neutron [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:53:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-9572fe57-998e-4ac5-b961-a2940203d906 req-4c9f95d7-9075-4a5c-a5bb-d500aa0cbc8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-changed-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-9572fe57-998e-4ac5-b961-a2940203d906 req-4c9f95d7-9075-4a5c-a5bb-d500aa0cbc8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Refreshing instance network info cache due to event network-changed-fc82c8ce-2156-4af8-97c8-5de08f051d07. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:53:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9572fe57-998e-4ac5-b961-a2940203d906 req-4c9f95d7-9075-4a5c-a5bb-d500aa0cbc8c service nova] Acquiring lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:53:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG nova.network.neutron [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updating instance_info_cache with network_info: [{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Releasing lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:53:02 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Creating image(s)
Jul 25 15:53:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG nova.objects.instance [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9572fe57-998e-4ac5-b961-a2940203d906 req-4c9f95d7-9075-4a5c-a5bb-d500aa0cbc8c service nova] Acquired lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-9572fe57-998e-4ac5-b961-a2940203d906 req-4c9f95d7-9075-4a5c-a5bb-d500aa0cbc8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Refreshing network info cache for port fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "3dbe680999be8bde98134e1e5ebefeb8ad2e0134" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "3dbe680999be8bde98134e1e5ebefeb8ad2e0134" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134.part --force-share --output=json" returned: 0 in 0.168s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:03 user nova-compute[70869]: DEBUG nova.virt.images [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] 5d90df0a-9fa8-460b-8075-0ec7398c28a0 was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:53:03 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:53:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134.part /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:04 user nova-compute[70869]: DEBUG nova.network.neutron [req-9572fe57-998e-4ac5-b961-a2940203d906 req-4c9f95d7-9075-4a5c-a5bb-d500aa0cbc8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updated VIF entry in instance network info cache for port fc82c8ce-2156-4af8-97c8-5de08f051d07. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:53:04 user nova-compute[70869]: DEBUG nova.network.neutron [req-9572fe57-998e-4ac5-b961-a2940203d906 req-4c9f95d7-9075-4a5c-a5bb-d500aa0cbc8c service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updating instance_info_cache with network_info: [{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:53:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9572fe57-998e-4ac5-b961-a2940203d906 req-4c9f95d7-9075-4a5c-a5bb-d500aa0cbc8c service nova] Releasing lock "refresh_cache-90bbd516-9124-423e-9bc8-2795c4e39c0e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:53:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134.part /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134.converted" returned: 0 in 1.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "3dbe680999be8bde98134e1e5ebefeb8ad2e0134" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.641s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134 --force-share --output=json" returned: 0 in 0.170s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "3dbe680999be8bde98134e1e5ebefeb8ad2e0134" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "3dbe680999be8bde98134e1e5ebefeb8ad2e0134" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134 --force-share --output=json" returned: 0 in 0.156s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134,backing_fmt=raw /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134,backing_fmt=raw /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk 1073741824" returned: 0 in 0.058s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "3dbe680999be8bde98134e1e5ebefeb8ad2e0134" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134 --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG nova.objects.instance [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'migration_context' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:53:05 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Rebasing disk image.
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 -F raw /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 -F raw /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk" returned: 0 in 2.628s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Ensure instance console log exists: /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Start _get_guest_xml network_info=[{"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c2fa06766b89bfb26df622e2841c3a55',container_format='bare',created_at=2023-07-25T15:51:07Z,direct_url=<?>,disk_format='qcow2',id=5d90df0a-9fa8-460b-8075-0ec7398c28a0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1065132208-shelved',owner='fbda092d639f48ae873b25823e3547fe',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-25T15:51:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:53:08 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:53:08 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c2fa06766b89bfb26df622e2841c3a55',container_format='bare',created_at=2023-07-25T15:51:07Z,direct_url=<?>,disk_format='qcow2',id=5d90df0a-9fa8-460b-8075-0ec7398c28a0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1065132208-shelved',owner='fbda092d639f48ae873b25823e3547fe',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-25T15:51:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.objects.instance [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1065132208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1065132208',id=34,image_ref='5d90df0a-9fa8-460b-8075-0ec7398c28a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1502387404',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:49:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-i3po3re1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member',shelved_at='2023-07-25T15:51:11.456918',shelved_host='user',shelved_image_id='5d90df0a-9fa8-460b-8075-0ec7398c28a0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:53:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=90bbd516-9124-423e-9bc8-2795c4e39c0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.objects.instance [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'pci_devices' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:53:08 user nova-compute[70869]:   <uuid>90bbd516-9124-423e-9bc8-2795c4e39c0e</uuid>
Jul 25 15:53:08 user nova-compute[70869]:   <name>instance-00000022</name>
Jul 25 15:53:08 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:53:08 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:53:08 user nova-compute[70869]:   <metadata>
Jul 25 15:53:08 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:53:08 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:53:08 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1065132208</nova:name>
Jul 25 15:53:08 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:53:08</nova:creationTime>
Jul 25 15:53:08 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:53:08 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:53:08 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:53:08 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:53:08 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:53:08 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:53:08 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:53:08 user nova-compute[70869]:       <nova:owner>
Jul 25 15:53:08 user nova-compute[70869]:         <nova:user uuid="713c16113e88444fb17474020846c914">tempest-AttachVolumeShelveTestJSON-1783080081-project-member</nova:user>
Jul 25 15:53:08 user nova-compute[70869]:         <nova:project uuid="fbda092d639f48ae873b25823e3547fe">tempest-AttachVolumeShelveTestJSON-1783080081</nova:project>
Jul 25 15:53:08 user nova-compute[70869]:       </nova:owner>
Jul 25 15:53:08 user nova-compute[70869]:       <nova:root type="image" uuid="5d90df0a-9fa8-460b-8075-0ec7398c28a0"/>
Jul 25 15:53:08 user nova-compute[70869]:       <nova:ports>
Jul 25 15:53:08 user nova-compute[70869]:         <nova:port uuid="fc82c8ce-2156-4af8-97c8-5de08f051d07">
Jul 25 15:53:08 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 15:53:08 user nova-compute[70869]:         </nova:port>
Jul 25 15:53:08 user nova-compute[70869]:       </nova:ports>
Jul 25 15:53:08 user nova-compute[70869]:     </nova:instance>
Jul 25 15:53:08 user nova-compute[70869]:   </metadata>
Jul 25 15:53:08 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:53:08 user nova-compute[70869]:     <system>
Jul 25 15:53:08 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:53:08 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:53:08 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:53:08 user nova-compute[70869]:       <entry name="serial">90bbd516-9124-423e-9bc8-2795c4e39c0e</entry>
Jul 25 15:53:08 user nova-compute[70869]:       <entry name="uuid">90bbd516-9124-423e-9bc8-2795c4e39c0e</entry>
Jul 25 15:53:08 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:53:08 user nova-compute[70869]:     </system>
Jul 25 15:53:08 user nova-compute[70869]:   </sysinfo>
Jul 25 15:53:08 user nova-compute[70869]:   <os>
Jul 25 15:53:08 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:53:08 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:53:08 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:53:08 user nova-compute[70869]:   </os>
Jul 25 15:53:08 user nova-compute[70869]:   <features>
Jul 25 15:53:08 user nova-compute[70869]:     <acpi/>
Jul 25 15:53:08 user nova-compute[70869]:     <apic/>
Jul 25 15:53:08 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:53:08 user nova-compute[70869]:   </features>
Jul 25 15:53:08 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:53:08 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:53:08 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:53:08 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:53:08 user nova-compute[70869]:   </clock>
Jul 25 15:53:08 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:53:08 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:53:08 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:53:08 user nova-compute[70869]:   </cpu>
Jul 25 15:53:08 user nova-compute[70869]:   <devices>
Jul 25 15:53:08 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:53:08 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:53:08 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk"/>
Jul 25 15:53:08 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:53:08 user nova-compute[70869]:     </disk>
Jul 25 15:53:08 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:53:08 user nova-compute[70869]:       <mac address="fa:16:3e:97:15:10"/>
Jul 25 15:53:08 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:53:08 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:53:08 user nova-compute[70869]:       <target dev="tapfc82c8ce-21"/>
Jul 25 15:53:08 user nova-compute[70869]:     </interface>
Jul 25 15:53:08 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:53:08 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/console.log" append="off"/>
Jul 25 15:53:08 user nova-compute[70869]:     </serial>
Jul 25 15:53:08 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:53:08 user nova-compute[70869]:     <video>
Jul 25 15:53:08 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:53:08 user nova-compute[70869]:     </video>
Jul 25 15:53:08 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:53:08 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:53:08 user nova-compute[70869]:     </rng>
Jul 25 15:53:08 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:53:08 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:53:08 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:53:08 user nova-compute[70869]:     </memballoon>
Jul 25 15:53:08 user nova-compute[70869]:   </devices>
Jul 25 15:53:08 user nova-compute[70869]: </domain>
Jul 25 15:53:08 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1065132208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1065132208',id=34,image_ref='5d90df0a-9fa8-460b-8075-0ec7398c28a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1502387404',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:49:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-i3po3re1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member',shelved_at='2023-07-25T15:51:11.456918',shelved_host='user',shelved_image_id='5d90df0a-9fa8-460b-8075-0ec7398c28a0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:53:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=90bbd516-9124-423e-9bc8-2795c4e39c0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG os_vif [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc82c8ce-21, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc82c8ce-21, col_values=(('external_ids', {'iface-id': 'fc82c8ce-2156-4af8-97c8-5de08f051d07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:15:10', 'vm-uuid': '90bbd516-9124-423e-9bc8-2795c4e39c0e'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:08 user nova-compute[70869]: INFO os_vif [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21')
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:53:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] No VIF found with MAC fa:16:3e:97:15:10, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:53:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-8695d0a3-e2cd-4309-8ffe-e85b2142b642 req-b2bc0b90-6a0d-4b06-afef-39e12200c082 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8695d0a3-e2cd-4309-8ffe-e85b2142b642 req-b2bc0b90-6a0d-4b06-afef-39e12200c082 service nova] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8695d0a3-e2cd-4309-8ffe-e85b2142b642 req-b2bc0b90-6a0d-4b06-afef-39e12200c082 service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8695d0a3-e2cd-4309-8ffe-e85b2142b642 req-b2bc0b90-6a0d-4b06-afef-39e12200c082 service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-8695d0a3-e2cd-4309-8ffe-e85b2142b642 req-b2bc0b90-6a0d-4b06-afef-39e12200c082 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] No waiting events found dispatching network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:10 user nova-compute[70869]: WARNING nova.compute.manager [req-8695d0a3-e2cd-4309-8ffe-e85b2142b642 req-b2bc0b90-6a0d-4b06-afef-39e12200c082 service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received unexpected event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 15:53:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300392.2490005, 90bbd516-9124-423e-9bc8-2795c4e39c0e => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:53:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] VM Resumed (Lifecycle Event)
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:53:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance spawned successfully.
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:53:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300392.2520568, 90bbd516-9124-423e-9bc8-2795c4e39c0e => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:53:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] VM Started (Lifecycle Event)
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-2f26685b-dda6-45da-b358-c59ffe95a873 req-2fcc44a5-a3d4-4754-b80e-05e72885891a service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2f26685b-dda6-45da-b358-c59ffe95a873 req-2fcc44a5-a3d4-4754-b80e-05e72885891a service nova] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2f26685b-dda6-45da-b358-c59ffe95a873 req-2fcc44a5-a3d4-4754-b80e-05e72885891a service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2f26685b-dda6-45da-b358-c59ffe95a873 req-2fcc44a5-a3d4-4754-b80e-05e72885891a service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-2f26685b-dda6-45da-b358-c59ffe95a873 req-2fcc44a5-a3d4-4754-b80e-05e72885891a service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] No waiting events found dispatching network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:12 user nova-compute[70869]: WARNING nova.compute.manager [req-2f26685b-dda6-45da-b358-c59ffe95a873 req-2fcc44a5-a3d4-4754-b80e-05e72885891a service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received unexpected event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:53:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:53:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:53:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-fd4dcf2b-6666-4926-b2b0-11b998c4b2d6 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.096s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:53:28 user nova-compute[70869]: INFO nova.compute.claims [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Claim successful on node user
Jul 25 15:53:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:53:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.policy [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9fac4d2818f46dc82613cf63b921a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43515216642447938c73f1a2536d095b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:53:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Creating image(s)
Jul 25 15:53:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "/opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "/opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "/opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk 1073741824" returned: 0 in 0.062s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Cannot resize image /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'migration_context' on Instance uuid 263aedd4-9dbd-4232-986a-e250505153e5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Ensure instance console log exists: /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:29 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Successfully created port: 03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Successfully updated port: 03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquired lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-3d0007a0-0167-44ca-9063-98dc6245c54b req-374ab352-7d87-4124-b1ed-9c4ec9ced07f service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received event network-changed-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-3d0007a0-0167-44ca-9063-98dc6245c54b req-374ab352-7d87-4124-b1ed-9c4ec9ced07f service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Refreshing instance network info cache due to event network-changed-03bf466d-6664-4d76-9140-5fcc289b5528. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3d0007a0-0167-44ca-9063-98dc6245c54b req-374ab352-7d87-4124-b1ed-9c4ec9ced07f service nova] Acquiring lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updating instance_info_cache with network_info: [{"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Releasing lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Instance network_info: |[{"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3d0007a0-0167-44ca-9063-98dc6245c54b req-374ab352-7d87-4124-b1ed-9c4ec9ced07f service nova] Acquired lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.network.neutron [req-3d0007a0-0167-44ca-9063-98dc6245c54b req-374ab352-7d87-4124-b1ed-9c4ec9ced07f service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Refreshing network info cache for port 03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Start _get_guest_xml network_info=[{"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:53:30 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:53:30 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-327261695',display_name='tempest-TestStampPattern-server-327261695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-327261695',id=37,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElU+k0rYhronu9BRexD90+MpLjOziUBLG+MBblKgeyeqhBtK3ZZxmOSTMgIcyGCVGFadf5Axe2ypZfEAo6F7i3fDoJINEYS2h5LlPs+FC+P6iRvLoE5Lhlii2I+TRFzJg==',key_name='tempest-TestStampPattern-1826637939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43515216642447938c73f1a2536d095b',ramdisk_id='',reservation_id='r-91crjekq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1006666307',owner_user_name='tempest-TestStampPattern-1006666307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:53:29Z,user_data=None,user_id='e9fac4d2818f46dc82613cf63b921a1b',uuid=263aedd4-9dbd-4232-986a-e250505153e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converting VIF {"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=03bf466d-6664-4d76-9140-5fcc289b5528,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf466d-66') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'pci_devices' on Instance uuid 263aedd4-9dbd-4232-986a-e250505153e5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:53:30 user nova-compute[70869]:   <uuid>263aedd4-9dbd-4232-986a-e250505153e5</uuid>
Jul 25 15:53:30 user nova-compute[70869]:   <name>instance-00000025</name>
Jul 25 15:53:30 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:53:30 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:53:30 user nova-compute[70869]:   <metadata>
Jul 25 15:53:30 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:53:30 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:53:30 user nova-compute[70869]:       <nova:name>tempest-TestStampPattern-server-327261695</nova:name>
Jul 25 15:53:30 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:53:30</nova:creationTime>
Jul 25 15:53:30 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:53:30 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:53:30 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:53:30 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:53:30 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:53:30 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:53:30 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:53:30 user nova-compute[70869]:       <nova:owner>
Jul 25 15:53:30 user nova-compute[70869]:         <nova:user uuid="e9fac4d2818f46dc82613cf63b921a1b">tempest-TestStampPattern-1006666307-project-member</nova:user>
Jul 25 15:53:30 user nova-compute[70869]:         <nova:project uuid="43515216642447938c73f1a2536d095b">tempest-TestStampPattern-1006666307</nova:project>
Jul 25 15:53:30 user nova-compute[70869]:       </nova:owner>
Jul 25 15:53:30 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:53:30 user nova-compute[70869]:       <nova:ports>
Jul 25 15:53:30 user nova-compute[70869]:         <nova:port uuid="03bf466d-6664-4d76-9140-5fcc289b5528">
Jul 25 15:53:30 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 15:53:30 user nova-compute[70869]:         </nova:port>
Jul 25 15:53:30 user nova-compute[70869]:       </nova:ports>
Jul 25 15:53:30 user nova-compute[70869]:     </nova:instance>
Jul 25 15:53:30 user nova-compute[70869]:   </metadata>
Jul 25 15:53:30 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:53:30 user nova-compute[70869]:     <system>
Jul 25 15:53:30 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:53:30 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:53:30 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:53:30 user nova-compute[70869]:       <entry name="serial">263aedd4-9dbd-4232-986a-e250505153e5</entry>
Jul 25 15:53:30 user nova-compute[70869]:       <entry name="uuid">263aedd4-9dbd-4232-986a-e250505153e5</entry>
Jul 25 15:53:30 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:53:30 user nova-compute[70869]:     </system>
Jul 25 15:53:30 user nova-compute[70869]:   </sysinfo>
Jul 25 15:53:30 user nova-compute[70869]:   <os>
Jul 25 15:53:30 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:53:30 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:53:30 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:53:30 user nova-compute[70869]:   </os>
Jul 25 15:53:30 user nova-compute[70869]:   <features>
Jul 25 15:53:30 user nova-compute[70869]:     <acpi/>
Jul 25 15:53:30 user nova-compute[70869]:     <apic/>
Jul 25 15:53:30 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:53:30 user nova-compute[70869]:   </features>
Jul 25 15:53:30 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:53:30 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:53:30 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:53:30 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:53:30 user nova-compute[70869]:   </clock>
Jul 25 15:53:30 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:53:30 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:53:30 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:53:30 user nova-compute[70869]:   </cpu>
Jul 25 15:53:30 user nova-compute[70869]:   <devices>
Jul 25 15:53:30 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:53:30 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:53:30 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk"/>
Jul 25 15:53:30 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:53:30 user nova-compute[70869]:     </disk>
Jul 25 15:53:30 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:53:30 user nova-compute[70869]:       <mac address="fa:16:3e:4b:33:8a"/>
Jul 25 15:53:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:53:30 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:53:30 user nova-compute[70869]:       <target dev="tap03bf466d-66"/>
Jul 25 15:53:30 user nova-compute[70869]:     </interface>
Jul 25 15:53:30 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:53:30 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/console.log" append="off"/>
Jul 25 15:53:30 user nova-compute[70869]:     </serial>
Jul 25 15:53:30 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:53:30 user nova-compute[70869]:     <video>
Jul 25 15:53:30 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:53:30 user nova-compute[70869]:     </video>
Jul 25 15:53:30 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:53:30 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:53:30 user nova-compute[70869]:     </rng>
Jul 25 15:53:30 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:53:30 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:53:30 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:53:30 user nova-compute[70869]:     </memballoon>
Jul 25 15:53:30 user nova-compute[70869]:   </devices>
Jul 25 15:53:30 user nova-compute[70869]: </domain>
Jul 25 15:53:30 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-327261695',display_name='tempest-TestStampPattern-server-327261695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-327261695',id=37,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElU+k0rYhronu9BRexD90+MpLjOziUBLG+MBblKgeyeqhBtK3ZZxmOSTMgIcyGCVGFadf5Axe2ypZfEAo6F7i3fDoJINEYS2h5LlPs+FC+P6iRvLoE5Lhlii2I+TRFzJg==',key_name='tempest-TestStampPattern-1826637939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43515216642447938c73f1a2536d095b',ramdisk_id='',reservation_id='r-91crjekq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1006666307',owner_user_name='tempest-TestStampPattern-1006666307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:53:29Z,user_data=None,user_id='e9fac4d2818f46dc82613cf63b921a1b',uuid=263aedd4-9dbd-4232-986a-e250505153e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converting VIF {"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=03bf466d-6664-4d76-9140-5fcc289b5528,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf466d-66') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG os_vif [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=03bf466d-6664-4d76-9140-5fcc289b5528,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf466d-66') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03bf466d-66, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03bf466d-66, col_values=(('external_ids', {'iface-id': '03bf466d-6664-4d76-9140-5fcc289b5528', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:33:8a', 'vm-uuid': '263aedd4-9dbd-4232-986a-e250505153e5'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:30 user nova-compute[70869]: INFO os_vif [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=03bf466d-6664-4d76-9140-5fcc289b5528,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf466d-66')
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:53:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No VIF found with MAC fa:16:3e:4b:33:8a, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:53:31 user nova-compute[70869]: DEBUG nova.network.neutron [req-3d0007a0-0167-44ca-9063-98dc6245c54b req-374ab352-7d87-4124-b1ed-9c4ec9ced07f service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updated VIF entry in instance network info cache for port 03bf466d-6664-4d76-9140-5fcc289b5528. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:53:31 user nova-compute[70869]: DEBUG nova.network.neutron [req-3d0007a0-0167-44ca-9063-98dc6245c54b req-374ab352-7d87-4124-b1ed-9c4ec9ced07f service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updating instance_info_cache with network_info: [{"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:53:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3d0007a0-0167-44ca-9063-98dc6245c54b req-374ab352-7d87-4124-b1ed-9c4ec9ced07f service nova] Releasing lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-478fb3ef-9753-4e80-928c-62b1fdbc5934 req-f93e5545-94db-40cf-bd1c-03137b55f217 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received event network-vif-plugged-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-478fb3ef-9753-4e80-928c-62b1fdbc5934 req-f93e5545-94db-40cf-bd1c-03137b55f217 service nova] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-478fb3ef-9753-4e80-928c-62b1fdbc5934 req-f93e5545-94db-40cf-bd1c-03137b55f217 service nova] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-478fb3ef-9753-4e80-928c-62b1fdbc5934 req-f93e5545-94db-40cf-bd1c-03137b55f217 service nova] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-478fb3ef-9753-4e80-928c-62b1fdbc5934 req-f93e5545-94db-40cf-bd1c-03137b55f217 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] No waiting events found dispatching network-vif-plugged-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:32 user nova-compute[70869]: WARNING nova.compute.manager [req-478fb3ef-9753-4e80-928c-62b1fdbc5934 req-f93e5545-94db-40cf-bd1c-03137b55f217 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received unexpected event network-vif-plugged-03bf466d-6664-4d76-9140-5fcc289b5528 for instance with vm_state building and task_state spawning.
Jul 25 15:53:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300414.380316, 263aedd4-9dbd-4232-986a-e250505153e5 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:53:34 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] VM Resumed (Lifecycle Event)
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:53:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Instance spawned successfully.
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:53:34 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300414.3862333, 263aedd4-9dbd-4232-986a-e250505153e5 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:53:34 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] VM Started (Lifecycle Event)
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:53:34 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:53:34 user nova-compute[70869]: INFO nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Took 5.65 seconds to spawn the instance on the hypervisor.
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:53:34 user nova-compute[70869]: INFO nova.compute.manager [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Took 6.56 seconds to build instance.
Jul 25 15:53:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a2b2de3d-30e5-49e0-bd1f-f4186104ce4c tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.680s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-be17d54f-8056-4aea-815d-f716cdd7de0a req-55cce36b-9035-4e02-9ee4-8da47e21da72 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received event network-vif-plugged-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be17d54f-8056-4aea-815d-f716cdd7de0a req-55cce36b-9035-4e02-9ee4-8da47e21da72 service nova] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be17d54f-8056-4aea-815d-f716cdd7de0a req-55cce36b-9035-4e02-9ee4-8da47e21da72 service nova] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-be17d54f-8056-4aea-815d-f716cdd7de0a req-55cce36b-9035-4e02-9ee4-8da47e21da72 service nova] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-be17d54f-8056-4aea-815d-f716cdd7de0a req-55cce36b-9035-4e02-9ee4-8da47e21da72 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] No waiting events found dispatching network-vif-plugged-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:34 user nova-compute[70869]: WARNING nova.compute.manager [req-be17d54f-8056-4aea-815d-f716cdd7de0a req-55cce36b-9035-4e02-9ee4-8da47e21da72 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received unexpected event network-vif-plugged-03bf466d-6664-4d76-9140-5fcc289b5528 for instance with vm_state active and task_state None.
Jul 25 15:53:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:43 user nova-compute[70869]: INFO nova.compute.manager [None req-6e127730-0cc2-4057-8138-9e9fff221fac tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Unrescuing
Jul 25 15:53:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e127730-0cc2-4057-8138-9e9fff221fac tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:53:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e127730-0cc2-4057-8138-9e9fff221fac tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquired lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:53:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6e127730-0cc2-4057-8138-9e9fff221fac tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:53:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG nova.network.neutron [None req-6e127730-0cc2-4057-8138-9e9fff221fac tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updating instance_info_cache with network_info: [{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-6e127730-0cc2-4057-8138-9e9fff221fac tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Releasing lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG nova.objects.instance [None req-6e127730-0cc2-4057-8138-9e9fff221fac tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'flavor' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-81e202e7-784b-417c-a911-de655d6aaafa req-e64a1a6d-264e-4263-b4f7-9a254ea10ab9 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-81e202e7-784b-417c-a911-de655d6aaafa req-e64a1a6d-264e-4263-b4f7-9a254ea10ab9 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-81e202e7-784b-417c-a911-de655d6aaafa req-e64a1a6d-264e-4263-b4f7-9a254ea10ab9 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-81e202e7-784b-417c-a911-de655d6aaafa req-e64a1a6d-264e-4263-b4f7-9a254ea10ab9 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-81e202e7-784b-417c-a911-de655d6aaafa req-e64a1a6d-264e-4263-b4f7-9a254ea10ab9 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:44 user nova-compute[70869]: WARNING nova.compute.manager [req-81e202e7-784b-417c-a911-de655d6aaafa req-e64a1a6d-264e-4263-b4f7-9a254ea10ab9 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Instance destroyed successfully.
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:46 user nova-compute[70869]: WARNING nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:46 user nova-compute[70869]: WARNING nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:46 user nova-compute[70869]: WARNING nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:46 user nova-compute[70869]: WARNING nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:46 user nova-compute[70869]: WARNING nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:46 user nova-compute[70869]: WARNING nova.compute.manager [req-62a7a903-84d3-4287-8f0f-8ceee17ca3a9 req-05db7d60-733f-4752-ab22-f7f7448adf8d service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:53:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-a3e830eb-0ff2-448a-9b15-5afcb6100b22 req-1f388712-17d9-42fe-af57-5d958ac9f430 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a3e830eb-0ff2-448a-9b15-5afcb6100b22 req-1f388712-17d9-42fe-af57-5d958ac9f430 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a3e830eb-0ff2-448a-9b15-5afcb6100b22 req-1f388712-17d9-42fe-af57-5d958ac9f430 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a3e830eb-0ff2-448a-9b15-5afcb6100b22 req-1f388712-17d9-42fe-af57-5d958ac9f430 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-a3e830eb-0ff2-448a-9b15-5afcb6100b22 req-1f388712-17d9-42fe-af57-5d958ac9f430 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:53:49 user nova-compute[70869]: WARNING nova.compute.manager [req-a3e830eb-0ff2-448a-9b15-5afcb6100b22 req-1f388712-17d9-42fe-af57-5d958ac9f430 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6e127730-0cc2-4057-8138-9e9fff221fac tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for e1ff49de-2dee-476c-8bf1-b70e64fe991e due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300428.69965, e1ff49de-2dee-476c-8bf1-b70e64fe991e => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:53:49 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] VM Resumed (Lifecycle Event)
Jul 25 15:53:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:53:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8313MB free_disk=25.423599243164062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:53:49 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300428.7011533, e1ff49de-2dee-476c-8bf1-b70e64fe991e => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:53:49 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] VM Started (Lifecycle Event)
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 90bbd516-9124-423e-9bc8-2795c4e39c0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 263aedd4-9dbd-4232-986a-e250505153e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:53:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:53:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:53:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:53:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:53:50 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:53:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:51 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updating instance_info_cache with network_info: [{"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:53:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:53:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:53:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:53:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:55 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:53:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:53:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:54:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:06 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:54:06 user nova-compute[70869]: INFO nova.compute.claims [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Claim successful on node user
Jul 25 15:54:06 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:54:06 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:54:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:54:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG nova.policy [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5652c0b752845cca61ba15971ef63fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcc8bf5793a4869bff694fb5bc8704f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:54:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Creating image(s)
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "/opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "/opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "/opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk 1073741824" returned: 0 in 0.056s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Successfully created port: 92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:54:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Cannot resize image /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG nova.objects.instance [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'migration_context' on Instance uuid d70f85c2-236d-4917-ad06-e9ed8213b376 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Ensure instance console log exists: /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Successfully updated port: 92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "refresh_cache-d70f85c2-236d-4917-ad06-e9ed8213b376" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquired lock "refresh_cache-d70f85c2-236d-4917-ad06-e9ed8213b376" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-af1ae53d-789e-4589-a42d-a7f3babfa797 req-31dd2c92-340f-4b6e-9857-6e67fea0c648 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received event network-changed-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG nova.compute.manager [req-af1ae53d-789e-4589-a42d-a7f3babfa797 req-31dd2c92-340f-4b6e-9857-6e67fea0c648 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Refreshing instance network info cache due to event network-changed-92dbe5f3-e615-4893-bc67-9955988030a9. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-af1ae53d-789e-4589-a42d-a7f3babfa797 req-31dd2c92-340f-4b6e-9857-6e67fea0c648 service nova] Acquiring lock "refresh_cache-d70f85c2-236d-4917-ad06-e9ed8213b376" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:54:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Updating instance_info_cache with network_info: [{"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Releasing lock "refresh_cache-d70f85c2-236d-4917-ad06-e9ed8213b376" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Instance network_info: |[{"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-af1ae53d-789e-4589-a42d-a7f3babfa797 req-31dd2c92-340f-4b6e-9857-6e67fea0c648 service nova] Acquired lock "refresh_cache-d70f85c2-236d-4917-ad06-e9ed8213b376" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-af1ae53d-789e-4589-a42d-a7f3babfa797 req-31dd2c92-340f-4b6e-9857-6e67fea0c648 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Refreshing network info cache for port 92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Start _get_guest_xml network_info=[{"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:54:09 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:54:09 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1991675404',display_name='tempest-VolumesSnapshotTestJSON-instance-1991675404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1991675404',id=38,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLo0xQivxgWxQU3Abn082Y5xaqk/TYZu+xRUd20f1YgiSlWYX9+zByXV8PIQz9naaaYuzWLERa0NDSYdk0An+ocEG1wgBZ6sBq8wrpKibjFhCCKL2DRKhotB8DqhFxlj/A==',key_name='tempest-keypair-1478341979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edcc8bf5793a4869bff694fb5bc8704f',ramdisk_id='',reservation_id='r-8l73kd4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-529637024',owner_user_name='tempest-VolumesSnapshotTestJSON-529637024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5652c0b752845cca61ba15971ef63fe',uuid=d70f85c2-236d-4917-ad06-e9ed8213b376,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converting VIF {"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=92dbe5f3-e615-4893-bc67-9955988030a9,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dbe5f3-e6') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.objects.instance [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'pci_devices' on Instance uuid d70f85c2-236d-4917-ad06-e9ed8213b376 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:54:09 user nova-compute[70869]:   <uuid>d70f85c2-236d-4917-ad06-e9ed8213b376</uuid>
Jul 25 15:54:09 user nova-compute[70869]:   <name>instance-00000026</name>
Jul 25 15:54:09 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:54:09 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:54:09 user nova-compute[70869]:   <metadata>
Jul 25 15:54:09 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:54:09 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:54:09 user nova-compute[70869]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1991675404</nova:name>
Jul 25 15:54:09 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:54:09</nova:creationTime>
Jul 25 15:54:09 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:54:09 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:54:09 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:54:09 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:54:09 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:54:09 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:54:09 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:54:09 user nova-compute[70869]:       <nova:owner>
Jul 25 15:54:09 user nova-compute[70869]:         <nova:user uuid="c5652c0b752845cca61ba15971ef63fe">tempest-VolumesSnapshotTestJSON-529637024-project-member</nova:user>
Jul 25 15:54:09 user nova-compute[70869]:         <nova:project uuid="edcc8bf5793a4869bff694fb5bc8704f">tempest-VolumesSnapshotTestJSON-529637024</nova:project>
Jul 25 15:54:09 user nova-compute[70869]:       </nova:owner>
Jul 25 15:54:09 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:54:09 user nova-compute[70869]:       <nova:ports>
Jul 25 15:54:09 user nova-compute[70869]:         <nova:port uuid="92dbe5f3-e615-4893-bc67-9955988030a9">
Jul 25 15:54:09 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 15:54:09 user nova-compute[70869]:         </nova:port>
Jul 25 15:54:09 user nova-compute[70869]:       </nova:ports>
Jul 25 15:54:09 user nova-compute[70869]:     </nova:instance>
Jul 25 15:54:09 user nova-compute[70869]:   </metadata>
Jul 25 15:54:09 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:54:09 user nova-compute[70869]:     <system>
Jul 25 15:54:09 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:54:09 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:54:09 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:54:09 user nova-compute[70869]:       <entry name="serial">d70f85c2-236d-4917-ad06-e9ed8213b376</entry>
Jul 25 15:54:09 user nova-compute[70869]:       <entry name="uuid">d70f85c2-236d-4917-ad06-e9ed8213b376</entry>
Jul 25 15:54:09 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:54:09 user nova-compute[70869]:     </system>
Jul 25 15:54:09 user nova-compute[70869]:   </sysinfo>
Jul 25 15:54:09 user nova-compute[70869]:   <os>
Jul 25 15:54:09 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:54:09 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:54:09 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:54:09 user nova-compute[70869]:   </os>
Jul 25 15:54:09 user nova-compute[70869]:   <features>
Jul 25 15:54:09 user nova-compute[70869]:     <acpi/>
Jul 25 15:54:09 user nova-compute[70869]:     <apic/>
Jul 25 15:54:09 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:54:09 user nova-compute[70869]:   </features>
Jul 25 15:54:09 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:54:09 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:54:09 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:54:09 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:54:09 user nova-compute[70869]:   </clock>
Jul 25 15:54:09 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:54:09 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:54:09 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:54:09 user nova-compute[70869]:   </cpu>
Jul 25 15:54:09 user nova-compute[70869]:   <devices>
Jul 25 15:54:09 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:54:09 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:54:09 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk"/>
Jul 25 15:54:09 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:54:09 user nova-compute[70869]:     </disk>
Jul 25 15:54:09 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:54:09 user nova-compute[70869]:       <mac address="fa:16:3e:8a:a7:54"/>
Jul 25 15:54:09 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:54:09 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:54:09 user nova-compute[70869]:       <target dev="tap92dbe5f3-e6"/>
Jul 25 15:54:09 user nova-compute[70869]:     </interface>
Jul 25 15:54:09 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:54:09 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/console.log" append="off"/>
Jul 25 15:54:09 user nova-compute[70869]:     </serial>
Jul 25 15:54:09 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:54:09 user nova-compute[70869]:     <video>
Jul 25 15:54:09 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:54:09 user nova-compute[70869]:     </video>
Jul 25 15:54:09 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:54:09 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:54:09 user nova-compute[70869]:     </rng>
Jul 25 15:54:09 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:54:09 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:54:09 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:54:09 user nova-compute[70869]:     </memballoon>
Jul 25 15:54:09 user nova-compute[70869]:   </devices>
Jul 25 15:54:09 user nova-compute[70869]: </domain>
Jul 25 15:54:09 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1991675404',display_name='tempest-VolumesSnapshotTestJSON-instance-1991675404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1991675404',id=38,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLo0xQivxgWxQU3Abn082Y5xaqk/TYZu+xRUd20f1YgiSlWYX9+zByXV8PIQz9naaaYuzWLERa0NDSYdk0An+ocEG1wgBZ6sBq8wrpKibjFhCCKL2DRKhotB8DqhFxlj/A==',key_name='tempest-keypair-1478341979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edcc8bf5793a4869bff694fb5bc8704f',ramdisk_id='',reservation_id='r-8l73kd4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-529637024',owner_user_name='tempest-VolumesSnapshotTestJSON-529637024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5652c0b752845cca61ba15971ef63fe',uuid=d70f85c2-236d-4917-ad06-e9ed8213b376,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converting VIF {"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=92dbe5f3-e615-4893-bc67-9955988030a9,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dbe5f3-e6') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG os_vif [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=92dbe5f3-e615-4893-bc67-9955988030a9,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dbe5f3-e6') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92dbe5f3-e6, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92dbe5f3-e6, col_values=(('external_ids', {'iface-id': '92dbe5f3-e615-4893-bc67-9955988030a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:a7:54', 'vm-uuid': 'd70f85c2-236d-4917-ad06-e9ed8213b376'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:09 user nova-compute[70869]: INFO os_vif [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=92dbe5f3-e615-4893-bc67-9955988030a9,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dbe5f3-e6')
Jul 25 15:54:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No VIF found with MAC fa:16:3e:8a:a7:54, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-af1ae53d-789e-4589-a42d-a7f3babfa797 req-31dd2c92-340f-4b6e-9857-6e67fea0c648 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Updated VIF entry in instance network info cache for port 92dbe5f3-e615-4893-bc67-9955988030a9. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-af1ae53d-789e-4589-a42d-a7f3babfa797 req-31dd2c92-340f-4b6e-9857-6e67fea0c648 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Updating instance_info_cache with network_info: [{"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:54:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-af1ae53d-789e-4589-a42d-a7f3babfa797 req-31dd2c92-340f-4b6e-9857-6e67fea0c648 service nova] Releasing lock "refresh_cache-d70f85c2-236d-4917-ad06-e9ed8213b376" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:54:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-4bc8f51e-ae28-483f-a9d4-a32200ad8592 req-60df8759-ead9-4c3a-a798-ec037d4b1acf service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received event network-vif-plugged-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:54:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4bc8f51e-ae28-483f-a9d4-a32200ad8592 req-60df8759-ead9-4c3a-a798-ec037d4b1acf service nova] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4bc8f51e-ae28-483f-a9d4-a32200ad8592 req-60df8759-ead9-4c3a-a798-ec037d4b1acf service nova] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4bc8f51e-ae28-483f-a9d4-a32200ad8592 req-60df8759-ead9-4c3a-a798-ec037d4b1acf service nova] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-4bc8f51e-ae28-483f-a9d4-a32200ad8592 req-60df8759-ead9-4c3a-a798-ec037d4b1acf service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] No waiting events found dispatching network-vif-plugged-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:54:10 user nova-compute[70869]: WARNING nova.compute.manager [req-4bc8f51e-ae28-483f-a9d4-a32200ad8592 req-60df8759-ead9-4c3a-a798-ec037d4b1acf service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received unexpected event network-vif-plugged-92dbe5f3-e615-4893-bc67-9955988030a9 for instance with vm_state building and task_state spawning.
Jul 25 15:54:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300452.7428687, d70f85c2-236d-4917-ad06-e9ed8213b376 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:54:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] VM Resumed (Lifecycle Event)
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:54:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Instance spawned successfully.
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:54:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300452.744854, d70f85c2-236d-4917-ad06-e9ed8213b376 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:54:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] VM Started (Lifecycle Event)
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:54:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:54:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Took 5.50 seconds to spawn the instance on the hypervisor.
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:54:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Took 6.29 seconds to build instance.
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-77ad39e1-7458-4e8d-b1d2-3144b72cb873 req-32ad576d-83f0-4618-86e0-345eac14d794 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received event network-vif-plugged-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-77ad39e1-7458-4e8d-b1d2-3144b72cb873 req-32ad576d-83f0-4618-86e0-345eac14d794 service nova] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-77ad39e1-7458-4e8d-b1d2-3144b72cb873 req-32ad576d-83f0-4618-86e0-345eac14d794 service nova] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-77ad39e1-7458-4e8d-b1d2-3144b72cb873 req-32ad576d-83f0-4618-86e0-345eac14d794 service nova] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-77ad39e1-7458-4e8d-b1d2-3144b72cb873 req-32ad576d-83f0-4618-86e0-345eac14d794 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] No waiting events found dispatching network-vif-plugged-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:54:12 user nova-compute[70869]: WARNING nova.compute.manager [req-77ad39e1-7458-4e8d-b1d2-3144b72cb873 req-32ad576d-83f0-4618-86e0-345eac14d794 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received unexpected event network-vif-plugged-92dbe5f3-e615-4893-bc67-9955988030a9 for instance with vm_state active and task_state None.
Jul 25 15:54:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8ff5d3ab-3d1b-498e-8a81-c62310595b11 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.388s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:44 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:54:45 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:54:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:54:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:54:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:54:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:54:45 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:54:45 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updating instance_info_cache with network_info: [{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:54:48 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:54:48 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8212MB free_disk=25.362831115722656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 90bbd516-9124-423e-9bc8-2795c4e39c0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 263aedd4-9dbd-4232-986a-e250505153e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d70f85c2-236d-4917-ad06-e9ed8213b376 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:54:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:49 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:54:49 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:54:49 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:54:49 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:54:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:50 user nova-compute[70869]: INFO nova.compute.manager [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Terminating instance
Jul 25 15:54:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d9ca76a-59f0-4e4f-8952-117b7ddab937 req-efd3617f-4e4a-4764-b6e2-0dddb3e7d6ca service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-unplugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d9ca76a-59f0-4e4f-8952-117b7ddab937 req-efd3617f-4e4a-4764-b6e2-0dddb3e7d6ca service nova] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d9ca76a-59f0-4e4f-8952-117b7ddab937 req-efd3617f-4e4a-4764-b6e2-0dddb3e7d6ca service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d9ca76a-59f0-4e4f-8952-117b7ddab937 req-efd3617f-4e4a-4764-b6e2-0dddb3e7d6ca service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d9ca76a-59f0-4e4f-8952-117b7ddab937 req-efd3617f-4e4a-4764-b6e2-0dddb3e7d6ca service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] No waiting events found dispatching network-vif-unplugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d9ca76a-59f0-4e4f-8952-117b7ddab937 req-efd3617f-4e4a-4764-b6e2-0dddb3e7d6ca service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-unplugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:54:50 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Instance destroyed successfully.
Jul 25 15:54:50 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lazy-loading 'resources' on Instance uuid 90bbd516-9124-423e-9bc8-2795c4e39c0e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-25T15:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1065132208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1065132208',id=34,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF0ANaxRmVSCrp5TNnfTSdH57zDshrQQgFfIGImg+oIYvFUVNtzacx9oJXoT1aN4jpciZXHWYDXwvMLVFSDUIpzfr97MGx7HKNfVv5///H4sfG8nWsMJvtcelfDh6Ni+w==',key_name='tempest-keypair-1502387404',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbda092d639f48ae873b25823e3547fe',ramdisk_id='',reservation_id='r-i3po3re1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1783080081',owner_user_name='tempest-AttachVolumeShelveTestJSON-1783080081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:53:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='713c16113e88444fb17474020846c914',uuid=90bbd516-9124-423e-9bc8-2795c4e39c0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converting VIF {"id": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "address": "fa:16:3e:97:15:10", "network": {"id": "60bf5d98-4398-4294-8518-74d8fe160283", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-226680563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbda092d639f48ae873b25823e3547fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc82c8ce-21", "ovs_interfaceid": "fc82c8ce-2156-4af8-97c8-5de08f051d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG os_vif [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc82c8ce-21, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:54:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:54:50 user nova-compute[70869]: INFO os_vif [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:15:10,bridge_name='br-int',has_traffic_filtering=True,id=fc82c8ce-2156-4af8-97c8-5de08f051d07,network=Network(60bf5d98-4398-4294-8518-74d8fe160283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc82c8ce-21')
Jul 25 15:54:50 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Deleting instance files /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e_del
Jul 25 15:54:50 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Deletion of /opt/stack/data/nova/instances/90bbd516-9124-423e-9bc8-2795c4e39c0e_del complete
Jul 25 15:54:51 user nova-compute[70869]: INFO nova.compute.manager [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 25 15:54:51 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:54:51 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:54:51 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:54:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:54:51 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:54:51 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Took 0.75 seconds to deallocate network for instance.
Jul 25 15:54:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:51 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:54:52 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:54:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:52 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Deleted allocations for instance 90bbd516-9124-423e-9bc8-2795c4e39c0e
Jul 25 15:54:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2a426897-d4e5-486d-97fc-3b8370fda5d9 tempest-AttachVolumeShelveTestJSON-1783080081 tempest-AttachVolumeShelveTestJSON-1783080081-project-member] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.833s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-dac25062-5cb5-47f6-8cee-1e7cc7671caa req-a9d0c6ae-3945-4524-8139-0b092d516d3e service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:54:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dac25062-5cb5-47f6-8cee-1e7cc7671caa req-a9d0c6ae-3945-4524-8139-0b092d516d3e service nova] Acquiring lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dac25062-5cb5-47f6-8cee-1e7cc7671caa req-a9d0c6ae-3945-4524-8139-0b092d516d3e service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dac25062-5cb5-47f6-8cee-1e7cc7671caa req-a9d0c6ae-3945-4524-8139-0b092d516d3e service nova] Lock "90bbd516-9124-423e-9bc8-2795c4e39c0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:54:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-dac25062-5cb5-47f6-8cee-1e7cc7671caa req-a9d0c6ae-3945-4524-8139-0b092d516d3e service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] No waiting events found dispatching network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:54:52 user nova-compute[70869]: WARNING nova.compute.manager [req-dac25062-5cb5-47f6-8cee-1e7cc7671caa req-a9d0c6ae-3945-4524-8139-0b092d516d3e service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received unexpected event network-vif-plugged-fc82c8ce-2156-4af8-97c8-5de08f051d07 for instance with vm_state deleted and task_state None.
Jul 25 15:54:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-dac25062-5cb5-47f6-8cee-1e7cc7671caa req-a9d0c6ae-3945-4524-8139-0b092d516d3e service nova] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Received event network-vif-deleted-fc82c8ce-2156-4af8-97c8-5de08f051d07 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:54:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:54:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:54:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "97e013dd-a78a-4cc9-949e-ba2c810f973c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:54:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:54:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:54:59 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:54:59 user nova-compute[70869]: INFO nova.compute.claims [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Claim successful on node user
Jul 25 15:55:00 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:55:00 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:55:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:55:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:55:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:55:00 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:55:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:55:00 user nova-compute[70869]: INFO nova.virt.block_device [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Booting with volume snapshot 790523f5-ba64-49f9-a344-4aa1fe5ba31a at /dev/vda
Jul 25 15:55:00 user nova-compute[70869]: DEBUG nova.policy [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f175a95c6c4e43b4b7d1910419070bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d4fe99fc224a2686f2f3daf32ecbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:55:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Successfully created port: 5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:55:00 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:55:01 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Successfully updated port: 5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:55:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "refresh_cache-97e013dd-a78a-4cc9-949e-ba2c810f973c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:55:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquired lock "refresh_cache-97e013dd-a78a-4cc9-949e-ba2c810f973c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:55:01 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:55:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-3fdc9abe-e90e-4fcf-a2b3-fc925567c66e req-20228152-72d2-4c65-8ada-02b4681b3c2d service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received event network-changed-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:55:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-3fdc9abe-e90e-4fcf-a2b3-fc925567c66e req-20228152-72d2-4c65-8ada-02b4681b3c2d service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Refreshing instance network info cache due to event network-changed-5c302ebb-2a5f-4549-942c-48075a0c4f4d. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:55:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3fdc9abe-e90e-4fcf-a2b3-fc925567c66e req-20228152-72d2-4c65-8ada-02b4681b3c2d service nova] Acquiring lock "refresh_cache-97e013dd-a78a-4cc9-949e-ba2c810f973c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:55:01 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:55:02 user nova-compute[70869]: DEBUG nova.network.neutron [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Updating instance_info_cache with network_info: [{"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:55:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Releasing lock "refresh_cache-97e013dd-a78a-4cc9-949e-ba2c810f973c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:55:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Instance network_info: |[{"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:55:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3fdc9abe-e90e-4fcf-a2b3-fc925567c66e req-20228152-72d2-4c65-8ada-02b4681b3c2d service nova] Acquired lock "refresh_cache-97e013dd-a78a-4cc9-949e-ba2c810f973c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:55:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-3fdc9abe-e90e-4fcf-a2b3-fc925567c66e req-20228152-72d2-4c65-8ada-02b4681b3c2d service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Refreshing network info cache for port 5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:55:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-3fdc9abe-e90e-4fcf-a2b3-fc925567c66e req-20228152-72d2-4c65-8ada-02b4681b3c2d service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Updated VIF entry in instance network info cache for port 5c302ebb-2a5f-4549-942c-48075a0c4f4d. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:55:02 user nova-compute[70869]: DEBUG nova.network.neutron [req-3fdc9abe-e90e-4fcf-a2b3-fc925567c66e req-20228152-72d2-4c65-8ada-02b4681b3c2d service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Updating instance_info_cache with network_info: [{"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:55:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3fdc9abe-e90e-4fcf-a2b3-fc925567c66e req-20228152-72d2-4c65-8ada-02b4681b3c2d service nova] Releasing lock "refresh_cache-97e013dd-a78a-4cc9-949e-ba2c810f973c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:55:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300490.9111483, 90bbd516-9124-423e-9bc8-2795c4e39c0e => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:55:05 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] VM Stopped (Lifecycle Event)
Jul 25 15:55:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-577719b1-0d31-45da-a81c-e8267e577bc9 None None] [instance: 90bbd516-9124-423e-9bc8-2795c4e39c0e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG os_brick.utils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a271655-2db2-46c5-a39d-dfa08c885540]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a91bfd-109f-416b-bf17-967205d37a3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[550815d9-0277-43a8-ad83-cae8b0e68543]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:05 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[632abf2d-1065-4d9b-9ffc-b8e6e7ede1e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:55:06 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:55:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c376ecc-6d37-48c6-876c-5568e06b2a5e]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG os_brick.utils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:55:06 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Updating existing volume attachment record: e3e99353-d38c-45e3-b6cb-a1a475b8c019 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:55:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:55:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Creating image(s)
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Ensure instance console log exists: /opt/stack/data/nova/instances/97e013dd-a78a-4cc9-949e-ba2c810f973c/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Start _get_guest_xml network_info=[{"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e3e99353-d38c-45e3-b6cb-a1a475b8c019', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weyrjEpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97e013dd-a78a-4cc9-949e-ba2c810f973c', 'attached_at': '', 'detached_at': '', 'volume_id': 'aaf3b9d4-9b5b-4017-84c1-734b6785ef65', 'serial': 'aaf3b9d4-9b5b-4017-84c1-734b6785ef65'}, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:55:12 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:55:12 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weyrjEpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:55:12 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:55:12 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:55:12 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[16148771-8b8c-414d-b095-d05393e7ec49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:55:12 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64bf607-dd02-4822-8722-fcd3a428fe7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65] added
Jul 25 15:55:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b915e8-4f98-429e-a93d-e2cf213ba7fb]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[728ff366-5a8a-4dee-88d2-f3d90151b6eb]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v weyrjEpo {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v weyrjEpo" returned: 0 in 0.033s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c324de-adb7-4dee-8751-1ff41fb84c50]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'weyrjEpo'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dd645f-bd97-429c-8fa3-b20c483e2196]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5e359-c539-417d-b217-64fa25cb9b7a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 15:55:12 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 15:55:12 user nova-compute[70869]:  {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:55:12 user nova-compute[70869]: WARNING os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 15:55:12 user nova-compute[70869]: 
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b93ff9-4072-4d53-bafe-071dd8df8a71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65, portal: 172.16.0.220,3260]
Jul 25 15:55:12 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65, portal: 172.16.0.220,3260] successful.
Jul 25 15:55:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[878bbe87-1a76-4bc3-9cef-e6c1668b4cb6]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f78762d-e32f-4544-87b1-e98596ce2c2b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:55:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:55:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3239b514-8a75-40b8-ace3-d33b0b1fa021]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weyrjEpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23162663663663837', 'path': '/dev/sdb'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162663663663837', 'path': '/dev/sdb'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1086614433',display_name='tempest-TestVolumeBootPattern-server-1086614433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1086614433',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-wgzcu3f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:55:00Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=97e013dd-a78a-4cc9-949e-ba2c810f973c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:82:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c302ebb-2a5f-4549-942c-48075a0c4f4d,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c302ebb-2a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.objects.instance [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'pci_devices' on Instance uuid 97e013dd-a78a-4cc9-949e-ba2c810f973c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:55:13 user nova-compute[70869]:   <uuid>97e013dd-a78a-4cc9-949e-ba2c810f973c</uuid>
Jul 25 15:55:13 user nova-compute[70869]:   <name>instance-00000027</name>
Jul 25 15:55:13 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:55:13 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:55:13 user nova-compute[70869]:   <metadata>
Jul 25 15:55:13 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:55:13 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:55:13 user nova-compute[70869]:       <nova:name>tempest-TestVolumeBootPattern-server-1086614433</nova:name>
Jul 25 15:55:13 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:55:12</nova:creationTime>
Jul 25 15:55:13 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:55:13 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:55:13 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:55:13 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:55:13 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:55:13 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:55:13 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:55:13 user nova-compute[70869]:       <nova:owner>
Jul 25 15:55:13 user nova-compute[70869]:         <nova:user uuid="f175a95c6c4e43b4b7d1910419070bf7">tempest-TestVolumeBootPattern-1492727042-project-member</nova:user>
Jul 25 15:55:13 user nova-compute[70869]:         <nova:project uuid="a0d4fe99fc224a2686f2f3daf32ecbd5">tempest-TestVolumeBootPattern-1492727042</nova:project>
Jul 25 15:55:13 user nova-compute[70869]:       </nova:owner>
Jul 25 15:55:13 user nova-compute[70869]:       <nova:ports>
Jul 25 15:55:13 user nova-compute[70869]:         <nova:port uuid="5c302ebb-2a5f-4549-942c-48075a0c4f4d">
Jul 25 15:55:13 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 15:55:13 user nova-compute[70869]:         </nova:port>
Jul 25 15:55:13 user nova-compute[70869]:       </nova:ports>
Jul 25 15:55:13 user nova-compute[70869]:     </nova:instance>
Jul 25 15:55:13 user nova-compute[70869]:   </metadata>
Jul 25 15:55:13 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:55:13 user nova-compute[70869]:     <system>
Jul 25 15:55:13 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:55:13 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:55:13 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:55:13 user nova-compute[70869]:       <entry name="serial">97e013dd-a78a-4cc9-949e-ba2c810f973c</entry>
Jul 25 15:55:13 user nova-compute[70869]:       <entry name="uuid">97e013dd-a78a-4cc9-949e-ba2c810f973c</entry>
Jul 25 15:55:13 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:55:13 user nova-compute[70869]:     </system>
Jul 25 15:55:13 user nova-compute[70869]:   </sysinfo>
Jul 25 15:55:13 user nova-compute[70869]:   <os>
Jul 25 15:55:13 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:55:13 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:55:13 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:55:13 user nova-compute[70869]:   </os>
Jul 25 15:55:13 user nova-compute[70869]:   <features>
Jul 25 15:55:13 user nova-compute[70869]:     <acpi/>
Jul 25 15:55:13 user nova-compute[70869]:     <apic/>
Jul 25 15:55:13 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:55:13 user nova-compute[70869]:   </features>
Jul 25 15:55:13 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:55:13 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:55:13 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:55:13 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:55:13 user nova-compute[70869]:   </clock>
Jul 25 15:55:13 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:55:13 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:55:13 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:55:13 user nova-compute[70869]:   </cpu>
Jul 25 15:55:13 user nova-compute[70869]:   <devices>
Jul 25 15:55:13 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:55:13 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:55:13 user nova-compute[70869]:       <source dev="/dev/sdb"/>
Jul 25 15:55:13 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:55:13 user nova-compute[70869]:       <serial>aaf3b9d4-9b5b-4017-84c1-734b6785ef65</serial>
Jul 25 15:55:13 user nova-compute[70869]:     </disk>
Jul 25 15:55:13 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:55:13 user nova-compute[70869]:       <mac address="fa:16:3e:1c:82:cd"/>
Jul 25 15:55:13 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:55:13 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:55:13 user nova-compute[70869]:       <target dev="tap5c302ebb-2a"/>
Jul 25 15:55:13 user nova-compute[70869]:     </interface>
Jul 25 15:55:13 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:55:13 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/97e013dd-a78a-4cc9-949e-ba2c810f973c/console.log" append="off"/>
Jul 25 15:55:13 user nova-compute[70869]:     </serial>
Jul 25 15:55:13 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:55:13 user nova-compute[70869]:     <video>
Jul 25 15:55:13 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:55:13 user nova-compute[70869]:     </video>
Jul 25 15:55:13 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:55:13 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:55:13 user nova-compute[70869]:     </rng>
Jul 25 15:55:13 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:55:13 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:55:13 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:55:13 user nova-compute[70869]:     </memballoon>
Jul 25 15:55:13 user nova-compute[70869]:   </devices>
Jul 25 15:55:13 user nova-compute[70869]: </domain>
Jul 25 15:55:13 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1086614433',display_name='tempest-TestVolumeBootPattern-server-1086614433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1086614433',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-wgzcu3f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:55:00Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=97e013dd-a78a-4cc9-949e-ba2c810f973c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:82:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c302ebb-2a5f-4549-942c-48075a0c4f4d,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c302ebb-2a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG os_vif [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:82:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c302ebb-2a5f-4549-942c-48075a0c4f4d,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c302ebb-2a') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c302ebb-2a, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c302ebb-2a, col_values=(('external_ids', {'iface-id': '5c302ebb-2a5f-4549-942c-48075a0c4f4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:82:cd', 'vm-uuid': '97e013dd-a78a-4cc9-949e-ba2c810f973c'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:13 user nova-compute[70869]: INFO os_vif [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:82:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c302ebb-2a5f-4549-942c-48075a0c4f4d,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c302ebb-2a')
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:55:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No VIF found with MAC fa:16:3e:1c:82:cd, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:55:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-4bf09357-2c97-4d29-aa73-43eb04201b1d req-56a32cc2-5bb7-483c-9ed4-3d1106b011b1 service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received event network-vif-plugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4bf09357-2c97-4d29-aa73-43eb04201b1d req-56a32cc2-5bb7-483c-9ed4-3d1106b011b1 service nova] Acquiring lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4bf09357-2c97-4d29-aa73-43eb04201b1d req-56a32cc2-5bb7-483c-9ed4-3d1106b011b1 service nova] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4bf09357-2c97-4d29-aa73-43eb04201b1d req-56a32cc2-5bb7-483c-9ed4-3d1106b011b1 service nova] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-4bf09357-2c97-4d29-aa73-43eb04201b1d req-56a32cc2-5bb7-483c-9ed4-3d1106b011b1 service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] No waiting events found dispatching network-vif-plugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:55:15 user nova-compute[70869]: WARNING nova.compute.manager [req-4bf09357-2c97-4d29-aa73-43eb04201b1d req-56a32cc2-5bb7-483c-9ed4-3d1106b011b1 service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received unexpected event network-vif-plugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d for instance with vm_state building and task_state spawning.
Jul 25 15:55:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300517.1719282, 97e013dd-a78a-4cc9-949e-ba2c810f973c => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:55:17 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] VM Resumed (Lifecycle Event)
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:55:17 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Instance spawned successfully.
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:17 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300517.1741655, 97e013dd-a78a-4cc9-949e-ba2c810f973c => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:55:17 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] VM Started (Lifecycle Event)
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:55:17 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:55:17 user nova-compute[70869]: INFO nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Took 5.01 seconds to spawn the instance on the hypervisor.
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-e82ec5fd-c5ef-4c64-a037-2708434209d0 req-4ff39405-8c81-49bc-b464-fc64104ee5ea service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received event network-vif-plugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e82ec5fd-c5ef-4c64-a037-2708434209d0 req-4ff39405-8c81-49bc-b464-fc64104ee5ea service nova] Acquiring lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e82ec5fd-c5ef-4c64-a037-2708434209d0 req-4ff39405-8c81-49bc-b464-fc64104ee5ea service nova] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e82ec5fd-c5ef-4c64-a037-2708434209d0 req-4ff39405-8c81-49bc-b464-fc64104ee5ea service nova] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-e82ec5fd-c5ef-4c64-a037-2708434209d0 req-4ff39405-8c81-49bc-b464-fc64104ee5ea service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] No waiting events found dispatching network-vif-plugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:55:17 user nova-compute[70869]: WARNING nova.compute.manager [req-e82ec5fd-c5ef-4c64-a037-2708434209d0 req-4ff39405-8c81-49bc-b464-fc64104ee5ea service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received unexpected event network-vif-plugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d for instance with vm_state building and task_state spawning.
Jul 25 15:55:17 user nova-compute[70869]: INFO nova.compute.manager [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Took 17.52 seconds to build instance.
Jul 25 15:55:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-4a3cfbcd-3db9-4164-b6c6-e8d25c354fce tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.619s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-6fcfccf5-cba8-47b4-b2c8-9ac24c2c8289 req-7993e4b6-ee75-4bdd-b5e4-e86a522722ba service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received event network-changed-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:55:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-6fcfccf5-cba8-47b4-b2c8-9ac24c2c8289 req-7993e4b6-ee75-4bdd-b5e4-e86a522722ba service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Refreshing instance network info cache due to event network-changed-03bf466d-6664-4d76-9140-5fcc289b5528. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:55:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6fcfccf5-cba8-47b4-b2c8-9ac24c2c8289 req-7993e4b6-ee75-4bdd-b5e4-e86a522722ba service nova] Acquiring lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:55:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6fcfccf5-cba8-47b4-b2c8-9ac24c2c8289 req-7993e4b6-ee75-4bdd-b5e4-e86a522722ba service nova] Acquired lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:55:20 user nova-compute[70869]: DEBUG nova.network.neutron [req-6fcfccf5-cba8-47b4-b2c8-9ac24c2c8289 req-7993e4b6-ee75-4bdd-b5e4-e86a522722ba service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Refreshing network info cache for port 03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:55:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-6fcfccf5-cba8-47b4-b2c8-9ac24c2c8289 req-7993e4b6-ee75-4bdd-b5e4-e86a522722ba service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updated VIF entry in instance network info cache for port 03bf466d-6664-4d76-9140-5fcc289b5528. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:55:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-6fcfccf5-cba8-47b4-b2c8-9ac24c2c8289 req-7993e4b6-ee75-4bdd-b5e4-e86a522722ba service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updating instance_info_cache with network_info: [{"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:55:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6fcfccf5-cba8-47b4-b2c8-9ac24c2c8289 req-7993e4b6-ee75-4bdd-b5e4-e86a522722ba service nova] Releasing lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG nova.objects.instance [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'flavor' on Instance uuid 263aedd4-9dbd-4232-986a-e250505153e5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:22 user nova-compute[70869]: INFO nova.compute.manager [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Attaching volume aab7952f-203f-4f0c-9d7d-e36155c4455b to /dev/vdb
Jul 25 15:55:22 user nova-compute[70869]: DEBUG os_brick.utils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[43928d53-2dc5-4812-a5a8-eb1ffabb770d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0409b923-a7d4-4503-9ee6-6462b75be478]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8765858-db90-40c2-9549-c77097cb86d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4f48b4-952c-4e08-9554-4ecf7059106c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:55:22 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:55:22 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[94094cb0-f578-4b82-97f6-c1be835c0d5e]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:55:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:55:23 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:55:23 user nova-compute[70869]: DEBUG os_brick.utils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:55:23 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updating existing volume attachment record: 61287b04-b0e0-4be0-9656-a9de7f8b13ea {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:55:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmRXMspg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:55:29 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:55:29 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:55:29 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8457d281-7d73-4887-a4c6-c9bbd2447be6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:55:29 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[029be29b-c1b2-4597-b2f0-8555b6bc7cf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b] added
Jul 25 15:55:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.055s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[18383cce-839f-460e-99b4-91a988d3305a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2cff94-6f42-4e07-a7fd-26d09721e5ea]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmRXMspg {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmRXMspg" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca3d09c-650b-4255-ac88-50a639ca99d0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NmRXMspg'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadfa1ec-361f-4937-87d0-cd6c8e287692]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93ca98d-13ea-4c18-97b9-5a840e61a0f7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:55:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:55:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed467dc-6da2-4820-b160-fdd422806aa6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b, portal: 172.16.0.220,3260]
Jul 25 15:55:29 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b, portal: 172.16.0.220,3260] successful.
Jul 25 15:55:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[197e103e-6565-4399-9b3f-6fa1fd4e010c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b3caea-3b3b-4157-a91c-c545472d0ba8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:55:29 user nova-compute[70869]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b (non-flash)
Jul 25 15:55:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:55:29 user nova-compute[70869]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b (non-flash)
Jul 25 15:55:29 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a41d84b-c665-445c-84e4-358d999847ba]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:55:29 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmRXMspg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:55:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:55:30 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26332386164326262', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:55:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332386164326262', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:55:30 user nova-compute[70869]: DEBUG nova.objects.instance [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'flavor' on Instance uuid 263aedd4-9dbd-4232-986a-e250505153e5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:55:30 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:55:30 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:55:30 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:55:30 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:55:30 user nova-compute[70869]:   <serial>aab7952f-203f-4f0c-9d7d-e36155c4455b</serial>
Jul 25 15:55:30 user nova-compute[70869]: </disk>
Jul 25 15:55:30 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:55:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:55:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:55:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No VIF found with MAC fa:16:3e:4b:33:8a, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:55:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-87285ba7-36e2-4078-a4ef-c65404293f16 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.572s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:34 user nova-compute[70869]: INFO nova.compute.manager [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Detaching volume aab7952f-203f-4f0c-9d7d-e36155c4455b
Jul 25 15:55:34 user nova-compute[70869]: INFO nova.virt.block_device [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Attempting to driver detach volume aab7952f-203f-4f0c-9d7d-e36155c4455b from mountpoint /dev/vdb
Jul 25 15:55:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Attempting to detach device vdb from instance 263aedd4-9dbd-4232-986a-e250505153e5 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:55:34 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:55:34 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:55:34 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:55:34 user nova-compute[70869]:   <serial>aab7952f-203f-4f0c-9d7d-e36155c4455b</serial>
Jul 25 15:55:34 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:55:34 user nova-compute[70869]: </disk>
Jul 25 15:55:34 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:55:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Successfully detached device vdb from instance 263aedd4-9dbd-4232-986a-e250505153e5 from the persistent domain config.
Jul 25 15:55:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 263aedd4-9dbd-4232-986a-e250505153e5 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:55:34 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:55:34 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:55:34 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:55:34 user nova-compute[70869]:   <serial>aab7952f-203f-4f0c-9d7d-e36155c4455b</serial>
Jul 25 15:55:34 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:55:34 user nova-compute[70869]: </disk>
Jul 25 15:55:34 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300534.958397, 263aedd4-9dbd-4232-986a-e250505153e5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 263aedd4-9dbd-4232-986a-e250505153e5 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:55:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Successfully detached device vdb from instance 263aedd4-9dbd-4232-986a-e250505153e5 from the live domain config.
Jul 25 15:55:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmRXMspg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:55:34 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:55:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb397841-9e6e-4c6f-9755-09f74fac65eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:55:34 user nova-compute[70869]: No targets found.
Jul 25 15:55:34 user nova-compute[70869]: iSNS:
Jul 25 15:55:34 user nova-compute[70869]: No targets found.
Jul 25 15:55:34 user nova-compute[70869]: STATIC:
Jul 25 15:55:34 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b
Jul 25 15:55:34 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:55:34 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:55:34 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65
Jul 25 15:55:34 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:55:34 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:55:34 user nova-compute[70869]: FIRMWARE:
Jul 25 15:55:34 user nova-compute[70869]: No targets found.
Jul 25 15:55:34 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:55:34 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:55:34 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:55:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e8426a-b7bd-4229-8311-c2a5547385ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[125749d0-a3cd-440b-814c-9fa8d85432ac]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:55:35 user nova-compute[70869]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b (non-flash)
Jul 25 15:55:35 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:55:35 user nova-compute[70869]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b (non-flash)
Jul 25 15:55:35 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4430b3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20ede2-e708-4c77-b06c-ceb65ff08231]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ba373f-4af8-44d8-a896-21dd287082d7]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[50885e28-fbff-489f-87bf-d5fb6531b3c3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[20101d83-ebbb-4715-946c-6e718149b532]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3009b850-cdc5-43c3-87a4-fe29f3ee276b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0361e72-5c80-4860-9a00-316bb832552c]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b, portal: 172.16.0.220,3260]
Jul 25 15:55:35 user nova-compute[70869]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b, portal: 172.16.0.220,3260] successful.
Jul 25 15:55:35 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aab7952f-203f-4f0c-9d7d-e36155c4455b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3143fe-343c-4046-bf5b-83678e7feab3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] <== disconnect_volume: return (297ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:55:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:55:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'flavor' on Instance uuid 263aedd4-9dbd-4232-986a-e250505153e5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:55:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2985d9d1-f8cd-4dad-9a89-ef2890aef86e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.728s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:55:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:40 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:55:40 user nova-compute[70869]: INFO nova.compute.claims [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Claim successful on node user
Jul 25 15:55:40 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:55:40 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:55:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:40 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:55:41 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:55:41 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Creating image(s)
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.policy [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cee3181b38f451a929907b0250f7ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a65674a8194f93a976d52353da0c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk 1073741824" returned: 0 in 0.109s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Cannot resize image /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'migration_context' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Ensure instance console log exists: /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:42 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Successfully created port: c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Successfully updated port: c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquired lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-5c485566-0211-458c-98cb-81c06a85ba10 req-f58b4546-48bd-40f8-bd16-b22bba8ee84b service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-changed-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-5c485566-0211-458c-98cb-81c06a85ba10 req-f58b4546-48bd-40f8-bd16-b22bba8ee84b service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Refreshing instance network info cache due to event network-changed-c0288dd3-2116-4c18-a4ca-73e0399ec75a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c485566-0211-458c-98cb-81c06a85ba10 req-f58b4546-48bd-40f8-bd16-b22bba8ee84b service nova] Acquiring lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.neutron [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating instance_info_cache with network_info: [{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Releasing lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Instance network_info: |[{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c485566-0211-458c-98cb-81c06a85ba10 req-f58b4546-48bd-40f8-bd16-b22bba8ee84b service nova] Acquired lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-5c485566-0211-458c-98cb-81c06a85ba10 req-f58b4546-48bd-40f8-bd16-b22bba8ee84b service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Refreshing network info cache for port c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Start _get_guest_xml network_info=[{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:55:43 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:55:43 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-559644806',display_name='tempest-ServerRescueNegativeTestJSON-server-559644806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-559644806',id=40,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI55a/pQOkt4Tpq7XzFSm0RXwMcragZEINMMx5bH6wRpqEvEt+C2XtIRdMumsJQPQfpcR4P41cr4GQZnzKTayL60NBWP94WnXczzsvLvFMheqv8lIDYmCgKAIWRJLX7JCA==',key_name='tempest-keypair-1296961173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-d94ycp9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cee3181b38f451a929907b0250f7ae0',uuid=d1ecb257-072c-4d1c-b2c4-15486ae66936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0288dd3-2116-4c18-a4ca-73e0399ec75a,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0288dd3-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'pci_devices' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:55:43 user nova-compute[70869]:   <uuid>d1ecb257-072c-4d1c-b2c4-15486ae66936</uuid>
Jul 25 15:55:43 user nova-compute[70869]:   <name>instance-00000028</name>
Jul 25 15:55:43 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:55:43 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:55:43 user nova-compute[70869]:   <metadata>
Jul 25 15:55:43 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:55:43 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:55:43 user nova-compute[70869]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-559644806</nova:name>
Jul 25 15:55:43 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:55:43</nova:creationTime>
Jul 25 15:55:43 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:55:43 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:55:43 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:55:43 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:55:43 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:55:43 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:55:43 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:55:43 user nova-compute[70869]:       <nova:owner>
Jul 25 15:55:43 user nova-compute[70869]:         <nova:user uuid="2cee3181b38f451a929907b0250f7ae0">tempest-ServerRescueNegativeTestJSON-2116380302-project-member</nova:user>
Jul 25 15:55:43 user nova-compute[70869]:         <nova:project uuid="40a65674a8194f93a976d52353da0c39">tempest-ServerRescueNegativeTestJSON-2116380302</nova:project>
Jul 25 15:55:43 user nova-compute[70869]:       </nova:owner>
Jul 25 15:55:43 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:55:43 user nova-compute[70869]:       <nova:ports>
Jul 25 15:55:43 user nova-compute[70869]:         <nova:port uuid="c0288dd3-2116-4c18-a4ca-73e0399ec75a">
Jul 25 15:55:43 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 15:55:43 user nova-compute[70869]:         </nova:port>
Jul 25 15:55:43 user nova-compute[70869]:       </nova:ports>
Jul 25 15:55:43 user nova-compute[70869]:     </nova:instance>
Jul 25 15:55:43 user nova-compute[70869]:   </metadata>
Jul 25 15:55:43 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:55:43 user nova-compute[70869]:     <system>
Jul 25 15:55:43 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:55:43 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:55:43 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:55:43 user nova-compute[70869]:       <entry name="serial">d1ecb257-072c-4d1c-b2c4-15486ae66936</entry>
Jul 25 15:55:43 user nova-compute[70869]:       <entry name="uuid">d1ecb257-072c-4d1c-b2c4-15486ae66936</entry>
Jul 25 15:55:43 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:55:43 user nova-compute[70869]:     </system>
Jul 25 15:55:43 user nova-compute[70869]:   </sysinfo>
Jul 25 15:55:43 user nova-compute[70869]:   <os>
Jul 25 15:55:43 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:55:43 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:55:43 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:55:43 user nova-compute[70869]:   </os>
Jul 25 15:55:43 user nova-compute[70869]:   <features>
Jul 25 15:55:43 user nova-compute[70869]:     <acpi/>
Jul 25 15:55:43 user nova-compute[70869]:     <apic/>
Jul 25 15:55:43 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:55:43 user nova-compute[70869]:   </features>
Jul 25 15:55:43 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:55:43 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:55:43 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:55:43 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:55:43 user nova-compute[70869]:   </clock>
Jul 25 15:55:43 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:55:43 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:55:43 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:55:43 user nova-compute[70869]:   </cpu>
Jul 25 15:55:43 user nova-compute[70869]:   <devices>
Jul 25 15:55:43 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:55:43 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:55:43 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk"/>
Jul 25 15:55:43 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:55:43 user nova-compute[70869]:     </disk>
Jul 25 15:55:43 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:55:43 user nova-compute[70869]:       <mac address="fa:16:3e:8c:c9:d0"/>
Jul 25 15:55:43 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:55:43 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:55:43 user nova-compute[70869]:       <target dev="tapc0288dd3-21"/>
Jul 25 15:55:43 user nova-compute[70869]:     </interface>
Jul 25 15:55:43 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:55:43 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/console.log" append="off"/>
Jul 25 15:55:43 user nova-compute[70869]:     </serial>
Jul 25 15:55:43 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:55:43 user nova-compute[70869]:     <video>
Jul 25 15:55:43 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:55:43 user nova-compute[70869]:     </video>
Jul 25 15:55:43 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:55:43 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:55:43 user nova-compute[70869]:     </rng>
Jul 25 15:55:43 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:55:43 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:55:43 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:55:43 user nova-compute[70869]:     </memballoon>
Jul 25 15:55:43 user nova-compute[70869]:   </devices>
Jul 25 15:55:43 user nova-compute[70869]: </domain>
Jul 25 15:55:43 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-559644806',display_name='tempest-ServerRescueNegativeTestJSON-server-559644806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-559644806',id=40,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI55a/pQOkt4Tpq7XzFSm0RXwMcragZEINMMx5bH6wRpqEvEt+C2XtIRdMumsJQPQfpcR4P41cr4GQZnzKTayL60NBWP94WnXczzsvLvFMheqv8lIDYmCgKAIWRJLX7JCA==',key_name='tempest-keypair-1296961173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-d94ycp9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cee3181b38f451a929907b0250f7ae0',uuid=d1ecb257-072c-4d1c-b2c4-15486ae66936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0288dd3-2116-4c18-a4ca-73e0399ec75a,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0288dd3-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG os_vif [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0288dd3-2116-4c18-a4ca-73e0399ec75a,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0288dd3-21') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0288dd3-21, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0288dd3-21, col_values=(('external_ids', {'iface-id': 'c0288dd3-2116-4c18-a4ca-73e0399ec75a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:c9:d0', 'vm-uuid': 'd1ecb257-072c-4d1c-b2c4-15486ae66936'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:43 user nova-compute[70869]: INFO os_vif [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0288dd3-2116-4c18-a4ca-73e0399ec75a,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0288dd3-21')
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No VIF found with MAC fa:16:3e:8c:c9:d0, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-5c485566-0211-458c-98cb-81c06a85ba10 req-f58b4546-48bd-40f8-bd16-b22bba8ee84b service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updated VIF entry in instance network info cache for port c0288dd3-2116-4c18-a4ca-73e0399ec75a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-5c485566-0211-458c-98cb-81c06a85ba10 req-f58b4546-48bd-40f8-bd16-b22bba8ee84b service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating instance_info_cache with network_info: [{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:55:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c485566-0211-458c-98cb-81c06a85ba10 req-f58b4546-48bd-40f8-bd16-b22bba8ee84b service nova] Releasing lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:55:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-32e3d85c-fe00-4d13-92c3-18c9114df4a2 req-2399346c-b63f-4aab-a39b-5f81a9560064 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-32e3d85c-fe00-4d13-92c3-18c9114df4a2 req-2399346c-b63f-4aab-a39b-5f81a9560064 service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-32e3d85c-fe00-4d13-92c3-18c9114df4a2 req-2399346c-b63f-4aab-a39b-5f81a9560064 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-32e3d85c-fe00-4d13-92c3-18c9114df4a2 req-2399346c-b63f-4aab-a39b-5f81a9560064 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-32e3d85c-fe00-4d13-92c3-18c9114df4a2 req-2399346c-b63f-4aab-a39b-5f81a9560064 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:55:45 user nova-compute[70869]: WARNING nova.compute.manager [req-32e3d85c-fe00-4d13-92c3-18c9114df4a2 req-2399346c-b63f-4aab-a39b-5f81a9560064 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state building and task_state spawning.
Jul 25 15:55:45 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:55:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300547.002328, d1ecb257-072c-4d1c-b2c4-15486ae66936 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:55:47 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] VM Resumed (Lifecycle Event)
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:55:47 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Instance spawned successfully.
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:55:47 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300547.0064785, d1ecb257-072c-4d1c-b2c4-15486ae66936 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:55:47 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] VM Started (Lifecycle Event)
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:55:47 user nova-compute[70869]: INFO nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Took 5.99 seconds to spawn the instance on the hypervisor.
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:55:47 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-a2fc2048-5ef6-426e-a45c-ffc4a8abc992 req-f54959d6-a352-404f-9736-406ba9bd9bb4 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a2fc2048-5ef6-426e-a45c-ffc4a8abc992 req-f54959d6-a352-404f-9736-406ba9bd9bb4 service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a2fc2048-5ef6-426e-a45c-ffc4a8abc992 req-f54959d6-a352-404f-9736-406ba9bd9bb4 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a2fc2048-5ef6-426e-a45c-ffc4a8abc992 req-f54959d6-a352-404f-9736-406ba9bd9bb4 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-a2fc2048-5ef6-426e-a45c-ffc4a8abc992 req-f54959d6-a352-404f-9736-406ba9bd9bb4 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:55:47 user nova-compute[70869]: WARNING nova.compute.manager [req-a2fc2048-5ef6-426e-a45c-ffc4a8abc992 req-f54959d6-a352-404f-9736-406ba9bd9bb4 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state building and task_state spawning.
Jul 25 15:55:47 user nova-compute[70869]: INFO nova.compute.manager [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Took 6.61 seconds to build instance.
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecde0ab-dc63-41d5-9c8b-ce36f2576a0d tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.769s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:48 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:55:48 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8173MB free_disk=25.371021270751953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 263aedd4-9dbd-4232-986a-e250505153e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d70f85c2-236d-4917-ad06-e9ed8213b376 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 97e013dd-a78a-4cc9-949e-ba2c810f973c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d1ecb257-072c-4d1c-b2c4-15486ae66936 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:55:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:49 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:55:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:55:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:55:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:55:50 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updating instance_info_cache with network_info: [{"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:55:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:55:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:55:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:55:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d76dd99-01b6-4380-8d64-04eac958f616 req-2f1d9f83-45f9-4eeb-b068-226b4ff572c5 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received event network-changed-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:55:57 user nova-compute[70869]: DEBUG nova.compute.manager [req-5d76dd99-01b6-4380-8d64-04eac958f616 req-2f1d9f83-45f9-4eeb-b068-226b4ff572c5 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Refreshing instance network info cache due to event network-changed-92dbe5f3-e615-4893-bc67-9955988030a9. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:55:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d76dd99-01b6-4380-8d64-04eac958f616 req-2f1d9f83-45f9-4eeb-b068-226b4ff572c5 service nova] Acquiring lock "refresh_cache-d70f85c2-236d-4917-ad06-e9ed8213b376" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:55:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d76dd99-01b6-4380-8d64-04eac958f616 req-2f1d9f83-45f9-4eeb-b068-226b4ff572c5 service nova] Acquired lock "refresh_cache-d70f85c2-236d-4917-ad06-e9ed8213b376" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:55:57 user nova-compute[70869]: DEBUG nova.network.neutron [req-5d76dd99-01b6-4380-8d64-04eac958f616 req-2f1d9f83-45f9-4eeb-b068-226b4ff572c5 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Refreshing network info cache for port 92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:55:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-5d76dd99-01b6-4380-8d64-04eac958f616 req-2f1d9f83-45f9-4eeb-b068-226b4ff572c5 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Updated VIF entry in instance network info cache for port 92dbe5f3-e615-4893-bc67-9955988030a9. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:55:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-5d76dd99-01b6-4380-8d64-04eac958f616 req-2f1d9f83-45f9-4eeb-b068-226b4ff572c5 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Updating instance_info_cache with network_info: [{"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:55:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5d76dd99-01b6-4380-8d64-04eac958f616 req-2f1d9f83-45f9-4eeb-b068-226b4ff572c5 service nova] Releasing lock "refresh_cache-d70f85c2-236d-4917-ad06-e9ed8213b376" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:55:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:58 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'flavor' on Instance uuid d70f85c2-236d-4917-ad06-e9ed8213b376 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:55:59 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Ignoring supplied device name: /dev/vdb
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:55:59 user nova-compute[70869]: INFO nova.compute.manager [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Attaching volume d54251be-8bab-4af7-99f1-96d55309c641 to /dev/vdb
Jul 25 15:55:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG os_brick.utils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92ae0c7-a560-469c-96ff-7682cd458a79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[131c6231-0f8a-4a6a-89fc-65711409492f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a9d215-3390-451c-a4ce-2fe33e394c69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbee155a-c90d-4fe4-b4ec-72ce4e394fa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:55:59 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:55:59 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3104f32f-140e-4fbf-a45c-fae7a1028d6f]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG os_brick.utils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:55:59 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Updating existing volume attachment record: 1e730aaf-62b5-424f-875b-acf3cc7f3898 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:56:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:05 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:56:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJwItERV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:56:05 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:56:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:56:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:56:05 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:56:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:56:05 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:56:05 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:56:05 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c80c09-cf4e-4267-9030-9cce3c93f203]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:56:06 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec42b760-cd8c-4c19-a361-4dd0d1929600]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641] added
Jul 25 15:56:06 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[099ea6c3-c960-4622-ad3e-5d0b994343ee]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d027d-767d-4beb-84a2-7ce0fbffddb4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJwItERV {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJwItERV" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3058130e-7ae9-4259-b3e7-d8edfdef4bb4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJwItERV'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c0a8a-7831-4e32-8eb7-870d1a82777d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb71013-d63e-4800-bdcd-465772a512f6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:06 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:06 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[adddd84a-f318-42f5-a03c-93bbac7fa4d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641, portal: 172.16.0.220,3260]
Jul 25 15:56:06 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641, portal: 172.16.0.220,3260] successful.
Jul 25 15:56:06 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d52001-3a2c-496d-a28e-8de82bae2ce3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2c0e3-64fb-4ee8-90b4-5c61b844105e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:06 user nova-compute[70869]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 (non-flash)
Jul 25 15:56:06 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:06 user nova-compute[70869]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 (non-flash)
Jul 25 15:56:06 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f871e9-f1f2-4beb-9419-8cf1a203e7e4]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJwItERV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:56:07 user nova-compute[70869]: INFO nova.compute.claims [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Claim successful on node user
Jul 25 15:56:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23463316266376465', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463316266376465', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'flavor' on Instance uuid d70f85c2-236d-4917-ad06-e9ed8213b376 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:56:07 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:56:07 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:56:07 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:56:07 user nova-compute[70869]:   <serial>d54251be-8bab-4af7-99f1-96d55309c641</serial>
Jul 25 15:56:07 user nova-compute[70869]: </disk>
Jul 25 15:56:07 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.network.neutron [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:56:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.policy [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41de05146fc5424a9f4b4852a3739135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bbd6a3baf146179b81bda84bdd466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:56:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Creating image(s)
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "/opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "/opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "/opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No VIF found with MAC fa:16:3e:8a:a7:54, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2463b9fc-0b71-4248-a168-b56768396207 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.673s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk 1073741824" returned: 0 in 0.046s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Successfully created port: 5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Cannot resize image /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG nova.objects.instance [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'migration_context' on Instance uuid 835a1495-de8c-4649-a4ef-266be7914aa6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Ensure instance console log exists: /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Successfully updated port: 5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "refresh_cache-835a1495-de8c-4649-a4ef-266be7914aa6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquired lock "refresh_cache-835a1495-de8c-4649-a4ef-266be7914aa6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:56:08 user nova-compute[70869]: DEBUG nova.network.neutron [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-80794db3-93d0-4141-9672-eb15a9bc728e req-5a303559-a560-4b0a-802a-ed213acac9d6 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received event network-changed-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.compute.manager [req-80794db3-93d0-4141-9672-eb15a9bc728e req-5a303559-a560-4b0a-802a-ed213acac9d6 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Refreshing instance network info cache due to event network-changed-5496ed94-107b-47ab-8c7a-6fb636ec7d5a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-80794db3-93d0-4141-9672-eb15a9bc728e req-5a303559-a560-4b0a-802a-ed213acac9d6 service nova] Acquiring lock "refresh_cache-835a1495-de8c-4649-a4ef-266be7914aa6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.network.neutron [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Updating instance_info_cache with network_info: [{"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Releasing lock "refresh_cache-835a1495-de8c-4649-a4ef-266be7914aa6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Instance network_info: |[{"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-80794db3-93d0-4141-9672-eb15a9bc728e req-5a303559-a560-4b0a-802a-ed213acac9d6 service nova] Acquired lock "refresh_cache-835a1495-de8c-4649-a4ef-266be7914aa6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-80794db3-93d0-4141-9672-eb15a9bc728e req-5a303559-a560-4b0a-802a-ed213acac9d6 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Refreshing network info cache for port 5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Start _get_guest_xml network_info=[{"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:56:09 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:56:09 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1023810021',display_name='tempest-AttachVolumeNegativeTest-server-1023810021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1023810021',id=41,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/sFxPcMJDwzu+7wilF4FKL9TvR/JWD1Bvjv6agcmrndNWKPZHbG12A7+Yy5z6ApihBRwfx3JXoNxdiw2g8eZNR4n2jIc67xv5e/o627eiSTdJuR0nP3D8KZ36RfVaXg==',key_name='tempest-keypair-2040054052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-q762bx0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=835a1495-de8c-4649-a4ef-266be7914aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=5496ed94-107b-47ab-8c7a-6fb636ec7d5a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496ed94-10') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.objects.instance [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'pci_devices' on Instance uuid 835a1495-de8c-4649-a4ef-266be7914aa6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:56:09 user nova-compute[70869]:   <uuid>835a1495-de8c-4649-a4ef-266be7914aa6</uuid>
Jul 25 15:56:09 user nova-compute[70869]:   <name>instance-00000029</name>
Jul 25 15:56:09 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:56:09 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:56:09 user nova-compute[70869]:   <metadata>
Jul 25 15:56:09 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:56:09 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:56:09 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1023810021</nova:name>
Jul 25 15:56:09 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:56:09</nova:creationTime>
Jul 25 15:56:09 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:56:09 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:56:09 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:56:09 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:56:09 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:56:09 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:56:09 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:56:09 user nova-compute[70869]:       <nova:owner>
Jul 25 15:56:09 user nova-compute[70869]:         <nova:user uuid="41de05146fc5424a9f4b4852a3739135">tempest-AttachVolumeNegativeTest-1624272753-project-member</nova:user>
Jul 25 15:56:09 user nova-compute[70869]:         <nova:project uuid="82bbd6a3baf146179b81bda84bdd466a">tempest-AttachVolumeNegativeTest-1624272753</nova:project>
Jul 25 15:56:09 user nova-compute[70869]:       </nova:owner>
Jul 25 15:56:09 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:56:09 user nova-compute[70869]:       <nova:ports>
Jul 25 15:56:09 user nova-compute[70869]:         <nova:port uuid="5496ed94-107b-47ab-8c7a-6fb636ec7d5a">
Jul 25 15:56:09 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 15:56:09 user nova-compute[70869]:         </nova:port>
Jul 25 15:56:09 user nova-compute[70869]:       </nova:ports>
Jul 25 15:56:09 user nova-compute[70869]:     </nova:instance>
Jul 25 15:56:09 user nova-compute[70869]:   </metadata>
Jul 25 15:56:09 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:56:09 user nova-compute[70869]:     <system>
Jul 25 15:56:09 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:56:09 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:56:09 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:56:09 user nova-compute[70869]:       <entry name="serial">835a1495-de8c-4649-a4ef-266be7914aa6</entry>
Jul 25 15:56:09 user nova-compute[70869]:       <entry name="uuid">835a1495-de8c-4649-a4ef-266be7914aa6</entry>
Jul 25 15:56:09 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:56:09 user nova-compute[70869]:     </system>
Jul 25 15:56:09 user nova-compute[70869]:   </sysinfo>
Jul 25 15:56:09 user nova-compute[70869]:   <os>
Jul 25 15:56:09 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:56:09 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:56:09 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:56:09 user nova-compute[70869]:   </os>
Jul 25 15:56:09 user nova-compute[70869]:   <features>
Jul 25 15:56:09 user nova-compute[70869]:     <acpi/>
Jul 25 15:56:09 user nova-compute[70869]:     <apic/>
Jul 25 15:56:09 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:56:09 user nova-compute[70869]:   </features>
Jul 25 15:56:09 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:56:09 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:56:09 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:56:09 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:56:09 user nova-compute[70869]:   </clock>
Jul 25 15:56:09 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:56:09 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:56:09 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:56:09 user nova-compute[70869]:   </cpu>
Jul 25 15:56:09 user nova-compute[70869]:   <devices>
Jul 25 15:56:09 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:56:09 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:56:09 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk"/>
Jul 25 15:56:09 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:56:09 user nova-compute[70869]:     </disk>
Jul 25 15:56:09 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:56:09 user nova-compute[70869]:       <mac address="fa:16:3e:c5:32:c8"/>
Jul 25 15:56:09 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:56:09 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:56:09 user nova-compute[70869]:       <target dev="tap5496ed94-10"/>
Jul 25 15:56:09 user nova-compute[70869]:     </interface>
Jul 25 15:56:09 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:56:09 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/console.log" append="off"/>
Jul 25 15:56:09 user nova-compute[70869]:     </serial>
Jul 25 15:56:09 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:56:09 user nova-compute[70869]:     <video>
Jul 25 15:56:09 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:56:09 user nova-compute[70869]:     </video>
Jul 25 15:56:09 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:56:09 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:56:09 user nova-compute[70869]:     </rng>
Jul 25 15:56:09 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:56:09 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:56:09 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:56:09 user nova-compute[70869]:     </memballoon>
Jul 25 15:56:09 user nova-compute[70869]:   </devices>
Jul 25 15:56:09 user nova-compute[70869]: </domain>
Jul 25 15:56:09 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1023810021',display_name='tempest-AttachVolumeNegativeTest-server-1023810021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1023810021',id=41,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/sFxPcMJDwzu+7wilF4FKL9TvR/JWD1Bvjv6agcmrndNWKPZHbG12A7+Yy5z6ApihBRwfx3JXoNxdiw2g8eZNR4n2jIc67xv5e/o627eiSTdJuR0nP3D8KZ36RfVaXg==',key_name='tempest-keypair-2040054052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-q762bx0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=835a1495-de8c-4649-a4ef-266be7914aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=5496ed94-107b-47ab-8c7a-6fb636ec7d5a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496ed94-10') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG os_vif [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=5496ed94-107b-47ab-8c7a-6fb636ec7d5a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496ed94-10') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5496ed94-10, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5496ed94-10, col_values=(('external_ids', {'iface-id': '5496ed94-107b-47ab-8c7a-6fb636ec7d5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:32:c8', 'vm-uuid': '835a1495-de8c-4649-a4ef-266be7914aa6'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:09 user nova-compute[70869]: INFO os_vif [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=5496ed94-107b-47ab-8c7a-6fb636ec7d5a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496ed94-10')
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No VIF found with MAC fa:16:3e:c5:32:c8, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-80794db3-93d0-4141-9672-eb15a9bc728e req-5a303559-a560-4b0a-802a-ed213acac9d6 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Updated VIF entry in instance network info cache for port 5496ed94-107b-47ab-8c7a-6fb636ec7d5a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG nova.network.neutron [req-80794db3-93d0-4141-9672-eb15a9bc728e req-5a303559-a560-4b0a-802a-ed213acac9d6 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Updating instance_info_cache with network_info: [{"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:56:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-80794db3-93d0-4141-9672-eb15a9bc728e req-5a303559-a560-4b0a-802a-ed213acac9d6 service nova] Releasing lock "refresh_cache-835a1495-de8c-4649-a4ef-266be7914aa6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:56:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-00f6d37d-affb-400c-a40b-37204a0ec8e7 req-6cffaa50-2528-46ab-b215-20f3369243e2 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received event network-vif-plugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-00f6d37d-affb-400c-a40b-37204a0ec8e7 req-6cffaa50-2528-46ab-b215-20f3369243e2 service nova] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-00f6d37d-affb-400c-a40b-37204a0ec8e7 req-6cffaa50-2528-46ab-b215-20f3369243e2 service nova] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-00f6d37d-affb-400c-a40b-37204a0ec8e7 req-6cffaa50-2528-46ab-b215-20f3369243e2 service nova] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:11 user nova-compute[70869]: DEBUG nova.compute.manager [req-00f6d37d-affb-400c-a40b-37204a0ec8e7 req-6cffaa50-2528-46ab-b215-20f3369243e2 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] No waiting events found dispatching network-vif-plugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:56:11 user nova-compute[70869]: WARNING nova.compute.manager [req-00f6d37d-affb-400c-a40b-37204a0ec8e7 req-6cffaa50-2528-46ab-b215-20f3369243e2 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received unexpected event network-vif-plugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a for instance with vm_state building and task_state spawning.
Jul 25 15:56:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300573.0796754, 835a1495-de8c-4649-a4ef-266be7914aa6 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:56:13 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] VM Resumed (Lifecycle Event)
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:56:13 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Instance spawned successfully.
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:56:13 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300573.0809247, 835a1495-de8c-4649-a4ef-266be7914aa6 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:56:13 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] VM Started (Lifecycle Event)
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:56:13 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-c0321b31-65b4-45b8-a3ae-31a02b224f79 req-9514b230-7b8e-45e7-b8b6-221f0c332ef9 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received event network-vif-plugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c0321b31-65b4-45b8-a3ae-31a02b224f79 req-9514b230-7b8e-45e7-b8b6-221f0c332ef9 service nova] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c0321b31-65b4-45b8-a3ae-31a02b224f79 req-9514b230-7b8e-45e7-b8b6-221f0c332ef9 service nova] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c0321b31-65b4-45b8-a3ae-31a02b224f79 req-9514b230-7b8e-45e7-b8b6-221f0c332ef9 service nova] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.compute.manager [req-c0321b31-65b4-45b8-a3ae-31a02b224f79 req-9514b230-7b8e-45e7-b8b6-221f0c332ef9 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] No waiting events found dispatching network-vif-plugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:56:13 user nova-compute[70869]: WARNING nova.compute.manager [req-c0321b31-65b4-45b8-a3ae-31a02b224f79 req-9514b230-7b8e-45e7-b8b6-221f0c332ef9 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received unexpected event network-vif-plugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a for instance with vm_state building and task_state spawning.
Jul 25 15:56:13 user nova-compute[70869]: INFO nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Took 5.56 seconds to spawn the instance on the hypervisor.
Jul 25 15:56:13 user nova-compute[70869]: DEBUG nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:56:13 user nova-compute[70869]: INFO nova.compute.manager [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Took 6.21 seconds to build instance.
Jul 25 15:56:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-296d3232-b1c6-4c15-9d14-99d2e3b33f97 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.298s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:56:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:29 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:56:30 user nova-compute[70869]: INFO nova.compute.manager [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] instance snapshotting
Jul 25 15:56:30 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Beginning live snapshot process
Jul 25 15:56:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json -f qcow2 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json -f qcow2 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu_az3p2j/57c21453f516444891c475f9fab33528.delta 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu_az3p2j/57c21453f516444891c475f9fab33528.delta 1073741824" returned: 0 in 0.053s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:30 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 25 15:56:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:56:31 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] COPY block job progress, current cursor: 74973184 final cursor: 75563008 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:56:32 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70869) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 25 15:56:32 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 25 15:56:32 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:56:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu_az3p2j/57c21453f516444891c475f9fab33528.delta /opt/stack/data/nova/instances/snapshots/tmpu_az3p2j/57c21453f516444891c475f9fab33528 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu_az3p2j/57c21453f516444891c475f9fab33528.delta /opt/stack/data/nova/instances/snapshots/tmpu_az3p2j/57c21453f516444891c475f9fab33528" returned: 0 in 0.801s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Snapshot extracted, beginning image upload
Jul 25 15:56:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:34 user nova-compute[70869]: INFO nova.compute.manager [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Detaching volume d54251be-8bab-4af7-99f1-96d55309c641
Jul 25 15:56:34 user nova-compute[70869]: INFO nova.virt.block_device [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Attempting to driver detach volume d54251be-8bab-4af7-99f1-96d55309c641 from mountpoint /dev/vdb
Jul 25 15:56:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Attempting to detach device vdb from instance d70f85c2-236d-4917-ad06-e9ed8213b376 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:56:35 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:56:35 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:56:35 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:56:35 user nova-compute[70869]:   <serial>d54251be-8bab-4af7-99f1-96d55309c641</serial>
Jul 25 15:56:35 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:56:35 user nova-compute[70869]: </disk>
Jul 25 15:56:35 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:56:35 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Successfully detached device vdb from instance d70f85c2-236d-4917-ad06-e9ed8213b376 from the persistent domain config.
Jul 25 15:56:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d70f85c2-236d-4917-ad06-e9ed8213b376 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:56:35 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:56:35 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 15:56:35 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:56:35 user nova-compute[70869]:   <serial>d54251be-8bab-4af7-99f1-96d55309c641</serial>
Jul 25 15:56:35 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:56:35 user nova-compute[70869]: </disk>
Jul 25 15:56:35 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300595.4504838, d70f85c2-236d-4917-ad06-e9ed8213b376 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d70f85c2-236d-4917-ad06-e9ed8213b376 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:56:35 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Successfully detached device vdb from instance d70f85c2-236d-4917-ad06-e9ed8213b376 from the live domain config.
Jul 25 15:56:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJwItERV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:56:35 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[784979e6-e0fb-49cc-985e-bdd64891e1cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:56:35 user nova-compute[70869]: No targets found.
Jul 25 15:56:35 user nova-compute[70869]: iSNS:
Jul 25 15:56:35 user nova-compute[70869]: No targets found.
Jul 25 15:56:35 user nova-compute[70869]: STATIC:
Jul 25 15:56:35 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65
Jul 25 15:56:35 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:56:35 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:56:35 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641
Jul 25 15:56:35 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:56:35 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:56:35 user nova-compute[70869]: FIRMWARE:
Jul 25 15:56:35 user nova-compute[70869]: No targets found.
Jul 25 15:56:35 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:56:35 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:56:35 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f810f38f-e7a5-4b93-976b-b28cf14bce5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4b02de-8def-47ee-ab23-de495e995ae1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:35 user nova-compute[70869]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 (non-flash)
Jul 25 15:56:35 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:35 user nova-compute[70869]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 (non-flash)
Jul 25 15:56:35 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe41c6e2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b49983-5ff4-403a-b401-14dcb5f89363]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[03df6188-acb5-4e5a-ad8d-9cf2c0906115]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa37fe2-7a65-4b0a-8ad3-06ffb43537d7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f3e3d6-15a3-481d-b829-ff63c845df04]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed32cd0-fc3f-456f-a182-7d850cc9b9e0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.230s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d290225c-f887-4624-aeef-1ec8617c9852]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641, portal: 172.16.0.220,3260]
Jul 25 15:56:35 user nova-compute[70869]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641, portal: 172.16.0.220,3260] successful.
Jul 25 15:56:35 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c725e-2414-4f98-91ab-3d3b3f9f12af]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] <== disconnect_volume: return (485ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:56:35 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:56:36 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Snapshot image upload complete
Jul 25 15:56:36 user nova-compute[70869]: INFO nova.compute.manager [None req-6c864d52-d6f1-4fe4-861d-67c47c924dfa tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Took 6.15 seconds to snapshot the instance on the hypervisor.
Jul 25 15:56:36 user nova-compute[70869]: DEBUG nova.objects.instance [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'flavor' on Instance uuid d70f85c2-236d-4917-ad06-e9ed8213b376 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:56:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-8a5e117e-8551-443e-906a-db22df5ed107 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.855s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.722s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:36 user nova-compute[70869]: INFO nova.compute.manager [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Terminating instance
Jul 25 15:56:36 user nova-compute[70869]: DEBUG nova.compute.manager [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:56:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-c0d4c43c-ead5-42c3-a19c-09d2d02faac6 req-528f57fd-6eba-4a69-bad6-69991b9f94cc service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received event network-vif-unplugged-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c0d4c43c-ead5-42c3-a19c-09d2d02faac6 req-528f57fd-6eba-4a69-bad6-69991b9f94cc service nova] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c0d4c43c-ead5-42c3-a19c-09d2d02faac6 req-528f57fd-6eba-4a69-bad6-69991b9f94cc service nova] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c0d4c43c-ead5-42c3-a19c-09d2d02faac6 req-528f57fd-6eba-4a69-bad6-69991b9f94cc service nova] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-c0d4c43c-ead5-42c3-a19c-09d2d02faac6 req-528f57fd-6eba-4a69-bad6-69991b9f94cc service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] No waiting events found dispatching network-vif-unplugged-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-c0d4c43c-ead5-42c3-a19c-09d2d02faac6 req-528f57fd-6eba-4a69-bad6-69991b9f94cc service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received event network-vif-unplugged-92dbe5f3-e615-4893-bc67-9955988030a9 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:56:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Instance destroyed successfully.
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.objects.instance [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'resources' on Instance uuid d70f85c2-236d-4917-ad06-e9ed8213b376 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1991675404',display_name='tempest-VolumesSnapshotTestJSON-instance-1991675404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1991675404',id=38,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLo0xQivxgWxQU3Abn082Y5xaqk/TYZu+xRUd20f1YgiSlWYX9+zByXV8PIQz9naaaYuzWLERa0NDSYdk0An+ocEG1wgBZ6sBq8wrpKibjFhCCKL2DRKhotB8DqhFxlj/A==',key_name='tempest-keypair-1478341979',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:54:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edcc8bf5793a4869bff694fb5bc8704f',ramdisk_id='',reservation_id='r-8l73kd4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-529637024',owner_user_name='tempest-VolumesSnapshotTestJSON-529637024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:54:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5652c0b752845cca61ba15971ef63fe',uuid=d70f85c2-236d-4917-ad06-e9ed8213b376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converting VIF {"id": "92dbe5f3-e615-4893-bc67-9955988030a9", "address": "fa:16:3e:8a:a7:54", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dbe5f3-e6", "ovs_interfaceid": "92dbe5f3-e615-4893-bc67-9955988030a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=92dbe5f3-e615-4893-bc67-9955988030a9,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dbe5f3-e6') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_vif [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=92dbe5f3-e615-4893-bc67-9955988030a9,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dbe5f3-e6') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92dbe5f3-e6, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:37 user nova-compute[70869]: INFO os_vif [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:a7:54,bridge_name='br-int',has_traffic_filtering=True,id=92dbe5f3-e615-4893-bc67-9955988030a9,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dbe5f3-e6')
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJwItERV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:56:37 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a566e46-81e7-4202-a40e-bc818cea6f64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:56:37 user nova-compute[70869]: No targets found.
Jul 25 15:56:37 user nova-compute[70869]: iSNS:
Jul 25 15:56:37 user nova-compute[70869]: No targets found.
Jul 25 15:56:37 user nova-compute[70869]: STATIC:
Jul 25 15:56:37 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65
Jul 25 15:56:37 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:56:37 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:56:37 user nova-compute[70869]: FIRMWARE:
Jul 25 15:56:37 user nova-compute[70869]: No targets found.
Jul 25 15:56:37 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:56:37 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:56:37 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d54251be-8bab-4af7-99f1-96d55309c641', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ece3cfe-9fc0-4fa1-9b6b-f072d79680a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccb430f-e1ce-4606-846a-0390470df4da]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:37 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:37 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c1dc160>, {}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Disconnecting from: [] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] <== disconnect_volume: return (72ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:56:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Deleting instance files /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376_del
Jul 25 15:56:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Deletion of /opt/stack/data/nova/instances/d70f85c2-236d-4917-ad06-e9ed8213b376_del complete
Jul 25 15:56:37 user nova-compute[70869]: INFO nova.compute.manager [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 25 15:56:37 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:56:37 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:56:38 user nova-compute[70869]: INFO nova.compute.claims [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Claim successful on node user
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:56:38 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Took 0.85 seconds to deallocate network for instance.
Jul 25 15:56:38 user nova-compute[70869]: WARNING nova.volume.cinder [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Attachment 1e730aaf-62b5-424f-875b-acf3cc7f3898 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1e730aaf-62b5-424f-875b-acf3cc7f3898. (HTTP 404) (Request-ID: req-55ab8465-3d18-4896-80a8-827ebdc1d7c4)
Jul 25 15:56:38 user nova-compute[70869]: INFO nova.compute.manager [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Took 0.03 seconds to detach 1 volumes for instance.
Jul 25 15:56:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.100s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:56:38 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:56:38 user nova-compute[70869]: DEBUG nova.policy [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9fac4d2818f46dc82613cf63b921a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43515216642447938c73f1a2536d095b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:56:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Creating image(s)
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "/opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "/opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "/opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "de8def195b8ea0783921cbc4136f6c39186e925c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "de8def195b8ea0783921cbc4136f6c39186e925c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c.part --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:39 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Deleted allocations for instance d70f85c2-236d-4917-ad06-e9ed8213b376
Jul 25 15:56:39 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Successfully created port: 81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-08dd87db-17b7-4d71-a91c-9e3f6adc40b2 req-9f370fdb-46c6-46cd-be78-a9978df7d4c9 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received event network-vif-plugged-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-08dd87db-17b7-4d71-a91c-9e3f6adc40b2 req-9f370fdb-46c6-46cd-be78-a9978df7d4c9 service nova] Acquiring lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-08dd87db-17b7-4d71-a91c-9e3f6adc40b2 req-9f370fdb-46c6-46cd-be78-a9978df7d4c9 service nova] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-08dd87db-17b7-4d71-a91c-9e3f6adc40b2 req-9f370fdb-46c6-46cd-be78-a9978df7d4c9 service nova] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-08dd87db-17b7-4d71-a91c-9e3f6adc40b2 req-9f370fdb-46c6-46cd-be78-a9978df7d4c9 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] No waiting events found dispatching network-vif-plugged-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:56:39 user nova-compute[70869]: WARNING nova.compute.manager [req-08dd87db-17b7-4d71-a91c-9e3f6adc40b2 req-9f370fdb-46c6-46cd-be78-a9978df7d4c9 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received unexpected event network-vif-plugged-92dbe5f3-e615-4893-bc67-9955988030a9 for instance with vm_state deleted and task_state None.
Jul 25 15:56:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-08dd87db-17b7-4d71-a91c-9e3f6adc40b2 req-9f370fdb-46c6-46cd-be78-a9978df7d4c9 service nova] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Received event network-vif-deleted-92dbe5f3-e615-4893-bc67-9955988030a9 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c.part --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG nova.virt.images [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] 63f8cb07-feeb-4468-bd4e-57ecb88fd5b1 was qcow2, converting to raw {{(pid=70869) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG nova.privsep.utils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70869) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c.part /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c.converted {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-50975f9d-7961-4b14-9afa-400c83bb2c56 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "d70f85c2-236d-4917-ad06-e9ed8213b376" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.361s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c.part /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c.converted" returned: 0 in 0.491s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c.converted --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "de8def195b8ea0783921cbc4136f6c39186e925c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.675s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Successfully updated port: 81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquired lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "de8def195b8ea0783921cbc4136f6c39186e925c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "de8def195b8ea0783921cbc4136f6c39186e925c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:40 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c,backing_fmt=raw /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c,backing_fmt=raw /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk 1073741824" returned: 0 in 0.057s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "de8def195b8ea0783921cbc4136f6c39186e925c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'migration_context' on Instance uuid 199a97cd-a3b3-4711-88dc-ab4239f996fc {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Ensure instance console log exists: /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.network.neutron [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Updating instance_info_cache with network_info: [{"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Releasing lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Instance network_info: |[{"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Start _get_guest_xml network_info=[{"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='95168e710cb5cd0e22fc1f2ffe6d9276',container_format='bare',created_at=2023-07-25T15:56:30Z,direct_url=<?>,disk_format='qcow2',id=63f8cb07-feeb-4468-bd4e-57ecb88fd5b1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1314391862',owner='43515216642447938c73f1a2536d095b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T15:56:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': '63f8cb07-feeb-4468-bd4e-57ecb88fd5b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:56:41 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:56:41 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='95168e710cb5cd0e22fc1f2ffe6d9276',container_format='bare',created_at=2023-07-25T15:56:30Z,direct_url=<?>,disk_format='qcow2',id=63f8cb07-feeb-4468-bd4e-57ecb88fd5b1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1314391862',owner='43515216642447938c73f1a2536d095b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-25T15:56:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1948827363',display_name='tempest-TestStampPattern-server-1948827363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1948827363',id=42,image_ref='63f8cb07-feeb-4468-bd4e-57ecb88fd5b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElU+k0rYhronu9BRexD90+MpLjOziUBLG+MBblKgeyeqhBtK3ZZxmOSTMgIcyGCVGFadf5Axe2ypZfEAo6F7i3fDoJINEYS2h5LlPs+FC+P6iRvLoE5Lhlii2I+TRFzJg==',key_name='tempest-TestStampPattern-1826637939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43515216642447938c73f1a2536d095b',ramdisk_id='',reservation_id='r-q5kpj8ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='263aedd4-9dbd-4232-986a-e250505153e5',image_min_disk='1',image_min_ram='0',image_owner_id='43515216642447938c73f1a2536d095b',image_owner_project_name='tempest-TestStampPattern-1006666307',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1006666307-project-member',image_user_id='e9fac4d2818f46dc82613cf63b921a1b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1006666307',owner_user_name='tempest-TestStampPattern-1006666307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:56:39Z,user_data=None,user_id='e9fac4d2818f46dc82613cf63b921a1b',uuid=199a97cd-a3b3-4711-88dc-ab4239f996fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converting VIF {"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=81b4303b-9d9b-4838-a470-f84b67f02900,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4303b-9d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'pci_devices' on Instance uuid 199a97cd-a3b3-4711-88dc-ab4239f996fc {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:56:41 user nova-compute[70869]:   <uuid>199a97cd-a3b3-4711-88dc-ab4239f996fc</uuid>
Jul 25 15:56:41 user nova-compute[70869]:   <name>instance-0000002a</name>
Jul 25 15:56:41 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:56:41 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:56:41 user nova-compute[70869]:   <metadata>
Jul 25 15:56:41 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:56:41 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:56:41 user nova-compute[70869]:       <nova:name>tempest-TestStampPattern-server-1948827363</nova:name>
Jul 25 15:56:41 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:56:41</nova:creationTime>
Jul 25 15:56:41 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:56:41 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:56:41 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:56:41 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:56:41 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:56:41 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:56:41 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:56:41 user nova-compute[70869]:       <nova:owner>
Jul 25 15:56:41 user nova-compute[70869]:         <nova:user uuid="e9fac4d2818f46dc82613cf63b921a1b">tempest-TestStampPattern-1006666307-project-member</nova:user>
Jul 25 15:56:41 user nova-compute[70869]:         <nova:project uuid="43515216642447938c73f1a2536d095b">tempest-TestStampPattern-1006666307</nova:project>
Jul 25 15:56:41 user nova-compute[70869]:       </nova:owner>
Jul 25 15:56:41 user nova-compute[70869]:       <nova:root type="image" uuid="63f8cb07-feeb-4468-bd4e-57ecb88fd5b1"/>
Jul 25 15:56:41 user nova-compute[70869]:       <nova:ports>
Jul 25 15:56:41 user nova-compute[70869]:         <nova:port uuid="81b4303b-9d9b-4838-a470-f84b67f02900">
Jul 25 15:56:41 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 25 15:56:41 user nova-compute[70869]:         </nova:port>
Jul 25 15:56:41 user nova-compute[70869]:       </nova:ports>
Jul 25 15:56:41 user nova-compute[70869]:     </nova:instance>
Jul 25 15:56:41 user nova-compute[70869]:   </metadata>
Jul 25 15:56:41 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:56:41 user nova-compute[70869]:     <system>
Jul 25 15:56:41 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:56:41 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:56:41 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:56:41 user nova-compute[70869]:       <entry name="serial">199a97cd-a3b3-4711-88dc-ab4239f996fc</entry>
Jul 25 15:56:41 user nova-compute[70869]:       <entry name="uuid">199a97cd-a3b3-4711-88dc-ab4239f996fc</entry>
Jul 25 15:56:41 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:56:41 user nova-compute[70869]:     </system>
Jul 25 15:56:41 user nova-compute[70869]:   </sysinfo>
Jul 25 15:56:41 user nova-compute[70869]:   <os>
Jul 25 15:56:41 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:56:41 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:56:41 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:56:41 user nova-compute[70869]:   </os>
Jul 25 15:56:41 user nova-compute[70869]:   <features>
Jul 25 15:56:41 user nova-compute[70869]:     <acpi/>
Jul 25 15:56:41 user nova-compute[70869]:     <apic/>
Jul 25 15:56:41 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:56:41 user nova-compute[70869]:   </features>
Jul 25 15:56:41 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:56:41 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:56:41 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:56:41 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:56:41 user nova-compute[70869]:   </clock>
Jul 25 15:56:41 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:56:41 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:56:41 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:56:41 user nova-compute[70869]:   </cpu>
Jul 25 15:56:41 user nova-compute[70869]:   <devices>
Jul 25 15:56:41 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:56:41 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:56:41 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk"/>
Jul 25 15:56:41 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:56:41 user nova-compute[70869]:     </disk>
Jul 25 15:56:41 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:56:41 user nova-compute[70869]:       <mac address="fa:16:3e:48:dd:74"/>
Jul 25 15:56:41 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:56:41 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:56:41 user nova-compute[70869]:       <target dev="tap81b4303b-9d"/>
Jul 25 15:56:41 user nova-compute[70869]:     </interface>
Jul 25 15:56:41 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:56:41 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/console.log" append="off"/>
Jul 25 15:56:41 user nova-compute[70869]:     </serial>
Jul 25 15:56:41 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:56:41 user nova-compute[70869]:     <video>
Jul 25 15:56:41 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:56:41 user nova-compute[70869]:     </video>
Jul 25 15:56:41 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:56:41 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:56:41 user nova-compute[70869]:     </rng>
Jul 25 15:56:41 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:56:41 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:56:41 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:56:41 user nova-compute[70869]:     </memballoon>
Jul 25 15:56:41 user nova-compute[70869]:   </devices>
Jul 25 15:56:41 user nova-compute[70869]: </domain>
Jul 25 15:56:41 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1948827363',display_name='tempest-TestStampPattern-server-1948827363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1948827363',id=42,image_ref='63f8cb07-feeb-4468-bd4e-57ecb88fd5b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElU+k0rYhronu9BRexD90+MpLjOziUBLG+MBblKgeyeqhBtK3ZZxmOSTMgIcyGCVGFadf5Axe2ypZfEAo6F7i3fDoJINEYS2h5LlPs+FC+P6iRvLoE5Lhlii2I+TRFzJg==',key_name='tempest-TestStampPattern-1826637939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43515216642447938c73f1a2536d095b',ramdisk_id='',reservation_id='r-q5kpj8ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='263aedd4-9dbd-4232-986a-e250505153e5',image_min_disk='1',image_min_ram='0',image_owner_id='43515216642447938c73f1a2536d095b',image_owner_project_name='tempest-TestStampPattern-1006666307',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1006666307-project-member',image_user_id='e9fac4d2818f46dc82613cf63b921a1b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1006666307',owner_user_name='tempest-TestStampPattern-1006666307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:56:39Z,user_data=None,user_id='e9fac4d2818f46dc82613cf63b921a1b',uuid=199a97cd-a3b3-4711-88dc-ab4239f996fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converting VIF {"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=81b4303b-9d9b-4838-a470-f84b67f02900,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4303b-9d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG os_vif [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=81b4303b-9d9b-4838-a470-f84b67f02900,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4303b-9d') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81b4303b-9d, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81b4303b-9d, col_values=(('external_ids', {'iface-id': '81b4303b-9d9b-4838-a470-f84b67f02900', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:dd:74', 'vm-uuid': '199a97cd-a3b3-4711-88dc-ab4239f996fc'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:41 user nova-compute[70869]: INFO os_vif [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=81b4303b-9d9b-4838-a470-f84b67f02900,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4303b-9d')
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-817f1c26-6f47-48c0-b539-074eaa616ab8 req-d0f513e0-da39-4e08-a555-2fc636077792 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received event network-changed-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-817f1c26-6f47-48c0-b539-074eaa616ab8 req-d0f513e0-da39-4e08-a555-2fc636077792 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Refreshing instance network info cache due to event network-changed-81b4303b-9d9b-4838-a470-f84b67f02900. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-817f1c26-6f47-48c0-b539-074eaa616ab8 req-d0f513e0-da39-4e08-a555-2fc636077792 service nova] Acquiring lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-817f1c26-6f47-48c0-b539-074eaa616ab8 req-d0f513e0-da39-4e08-a555-2fc636077792 service nova] Acquired lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.network.neutron [req-817f1c26-6f47-48c0-b539-074eaa616ab8 req-d0f513e0-da39-4e08-a555-2fc636077792 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Refreshing network info cache for port 81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No VIF found with MAC fa:16:3e:48:dd:74, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.network.neutron [req-817f1c26-6f47-48c0-b539-074eaa616ab8 req-d0f513e0-da39-4e08-a555-2fc636077792 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Updated VIF entry in instance network info cache for port 81b4303b-9d9b-4838-a470-f84b67f02900. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG nova.network.neutron [req-817f1c26-6f47-48c0-b539-074eaa616ab8 req-d0f513e0-da39-4e08-a555-2fc636077792 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Updating instance_info_cache with network_info: [{"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:56:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-817f1c26-6f47-48c0-b539-074eaa616ab8 req-d0f513e0-da39-4e08-a555-2fc636077792 service nova] Releasing lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:56:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-8b55c94b-d1e3-476b-af3a-8d89f7bd8f93 req-939ccdb2-f37e-47ae-8c2a-ee9b31ab4384 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received event network-vif-plugged-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8b55c94b-d1e3-476b-af3a-8d89f7bd8f93 req-939ccdb2-f37e-47ae-8c2a-ee9b31ab4384 service nova] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8b55c94b-d1e3-476b-af3a-8d89f7bd8f93 req-939ccdb2-f37e-47ae-8c2a-ee9b31ab4384 service nova] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8b55c94b-d1e3-476b-af3a-8d89f7bd8f93 req-939ccdb2-f37e-47ae-8c2a-ee9b31ab4384 service nova] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-8b55c94b-d1e3-476b-af3a-8d89f7bd8f93 req-939ccdb2-f37e-47ae-8c2a-ee9b31ab4384 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] No waiting events found dispatching network-vif-plugged-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:56:42 user nova-compute[70869]: WARNING nova.compute.manager [req-8b55c94b-d1e3-476b-af3a-8d89f7bd8f93 req-939ccdb2-f37e-47ae-8c2a-ee9b31ab4384 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received unexpected event network-vif-plugged-81b4303b-9d9b-4838-a470-f84b67f02900 for instance with vm_state building and task_state spawning.
Jul 25 15:56:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300604.9076865, 199a97cd-a3b3-4711-88dc-ab4239f996fc => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:56:44 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] VM Resumed (Lifecycle Event)
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:56:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Instance spawned successfully.
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:56:44 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300604.9090447, 199a97cd-a3b3-4711-88dc-ab4239f996fc => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:56:44 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] VM Started (Lifecycle Event)
Jul 25 15:56:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:56:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:56:45 user nova-compute[70869]: INFO nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Took 5.97 seconds to spawn the instance on the hypervisor.
Jul 25 15:56:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:56:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-c104fcd0-f6de-488b-b097-285cf4aab11c req-e917bc83-bc6b-4c42-a282-458a144099e8 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received event network-vif-plugged-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c104fcd0-f6de-488b-b097-285cf4aab11c req-e917bc83-bc6b-4c42-a282-458a144099e8 service nova] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c104fcd0-f6de-488b-b097-285cf4aab11c req-e917bc83-bc6b-4c42-a282-458a144099e8 service nova] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c104fcd0-f6de-488b-b097-285cf4aab11c req-e917bc83-bc6b-4c42-a282-458a144099e8 service nova] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-c104fcd0-f6de-488b-b097-285cf4aab11c req-e917bc83-bc6b-4c42-a282-458a144099e8 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] No waiting events found dispatching network-vif-plugged-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:56:45 user nova-compute[70869]: WARNING nova.compute.manager [req-c104fcd0-f6de-488b-b097-285cf4aab11c req-e917bc83-bc6b-4c42-a282-458a144099e8 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received unexpected event network-vif-plugged-81b4303b-9d9b-4838-a470-f84b67f02900 for instance with vm_state building and task_state spawning.
Jul 25 15:56:45 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:56:45 user nova-compute[70869]: INFO nova.compute.manager [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Took 6.80 seconds to build instance.
Jul 25 15:56:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e13e67ea-09bd-41f2-bd5d-e21cb50c4d20 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.904s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:56:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:56:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:56:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:56:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7968MB free_disk=25.187145233154297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 263aedd4-9dbd-4232-986a-e250505153e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 97e013dd-a78a-4cc9-949e-ba2c810f973c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d1ecb257-072c-4d1c-b2c4-15486ae66936 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 835a1495-de8c-4649-a4ef-266be7914aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 199a97cd-a3b3-4711-88dc-ab4239f996fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:56:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "97e013dd-a78a-4cc9-949e-ba2c810f973c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:50 user nova-compute[70869]: INFO nova.compute.manager [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Terminating instance
Jul 25 15:56:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:56:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-3017e4d8-c16c-49b8-b555-a6e6fdd35ac4 req-4632c8e6-bcff-4a15-b0c2-6d25a2e615e3 service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received event network-vif-unplugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3017e4d8-c16c-49b8-b555-a6e6fdd35ac4 req-4632c8e6-bcff-4a15-b0c2-6d25a2e615e3 service nova] Acquiring lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3017e4d8-c16c-49b8-b555-a6e6fdd35ac4 req-4632c8e6-bcff-4a15-b0c2-6d25a2e615e3 service nova] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3017e4d8-c16c-49b8-b555-a6e6fdd35ac4 req-4632c8e6-bcff-4a15-b0c2-6d25a2e615e3 service nova] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-3017e4d8-c16c-49b8-b555-a6e6fdd35ac4 req-4632c8e6-bcff-4a15-b0c2-6d25a2e615e3 service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] No waiting events found dispatching network-vif-unplugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-3017e4d8-c16c-49b8-b555-a6e6fdd35ac4 req-4632c8e6-bcff-4a15-b0c2-6d25a2e615e3 service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received event network-vif-unplugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Instance destroyed successfully.
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'resources' on Instance uuid 97e013dd-a78a-4cc9-949e-ba2c810f973c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1086614433',display_name='tempest-TestVolumeBootPattern-server-1086614433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1086614433',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:55:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-wgzcu3f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:55:17Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=97e013dd-a78a-4cc9-949e-ba2c810f973c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "address": "fa:16:3e:1c:82:cd", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c302ebb-2a", "ovs_interfaceid": "5c302ebb-2a5f-4549-942c-48075a0c4f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:82:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c302ebb-2a5f-4549-942c-48075a0c4f4d,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c302ebb-2a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_vif [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:82:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c302ebb-2a5f-4549-942c-48075a0c4f4d,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c302ebb-2a') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c302ebb-2a, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:56:51 user nova-compute[70869]: INFO os_vif [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:82:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c302ebb-2a5f-4549-942c-48075a0c4f4d,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c302ebb-2a')
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weyrjEpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:56:51 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e8853-3f0f-4acd-99fb-d65a05078bd8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:56:51 user nova-compute[70869]: No targets found.
Jul 25 15:56:51 user nova-compute[70869]: iSNS:
Jul 25 15:56:51 user nova-compute[70869]: No targets found.
Jul 25 15:56:51 user nova-compute[70869]: STATIC:
Jul 25 15:56:51 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65
Jul 25 15:56:51 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:56:51 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:56:51 user nova-compute[70869]: FIRMWARE:
Jul 25 15:56:51 user nova-compute[70869]: No targets found.
Jul 25 15:56:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:56:51 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:56:51 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[180147ac-69d1-4ec2-9033-9f3738eb1070]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a615ab-8cd9-43a3-a078-39ded7e54102]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 (non-flash)
Jul 25 15:56:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c153760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65'): ({'sdb'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Removing single pathed devices sdb {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe682fd-079b-4e7e-b8ac-023260e71e43]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc7770-2d30-4093-b5c0-2c291fd45a3a]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flushing IO for device /dev/sdb {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfbfe74-d293-4354-8ccb-0b394a6c0660]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c70d0f-fdd0-431e-a6ba-602fafaf901e]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf65018-64ca-4516-9c69-e6f908747c8d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[396994d1-ae9d-4729-a109-3b9bc944bd88]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65, portal: 172.16.0.220,3260]
Jul 25 15:56:51 user nova-compute[70869]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65, portal: 172.16.0.220,3260] successful.
Jul 25 15:56:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf3b9d4-9b5b-4017-84c1-734b6785ef65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a9c510-717e-44c3-b7a5-4bcdba72741c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== disconnect_volume: return (336ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:56:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Deleting instance files /opt/stack/data/nova/instances/97e013dd-a78a-4cc9-949e-ba2c810f973c_del
Jul 25 15:56:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Deletion of /opt/stack/data/nova/instances/97e013dd-a78a-4cc9-949e-ba2c810f973c_del complete
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:56:51 user nova-compute[70869]: INFO nova.compute.manager [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 25 15:56:51 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:56:51 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updating instance_info_cache with network_info: [{"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300597.521591, d70f85c2-236d-4917-ad06-e9ed8213b376 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:56:52 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] VM Stopped (Lifecycle Event)
Jul 25 15:56:52 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Took 0.56 seconds to deallocate network for instance.
Jul 25 15:56:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-59f135f4-5a53-4280-9ab1-3259d5571aa0 req-3ace02b7-c40c-4f5e-9034-7c54def95f24 service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received event network-vif-deleted-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-db97d58e-126f-4b7f-bb78-60e664c6ccd0 None None] [instance: d70f85c2-236d-4917-ad06-e9ed8213b376] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-a7ed24fe-1634-48a7-82d5-e79e90a84042 req-456bf7b0-b0f9-47f6-b023-9cc652c2d6ef service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received event network-vif-plugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a7ed24fe-1634-48a7-82d5-e79e90a84042 req-456bf7b0-b0f9-47f6-b023-9cc652c2d6ef service nova] Acquiring lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a7ed24fe-1634-48a7-82d5-e79e90a84042 req-456bf7b0-b0f9-47f6-b023-9cc652c2d6ef service nova] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a7ed24fe-1634-48a7-82d5-e79e90a84042 req-456bf7b0-b0f9-47f6-b023-9cc652c2d6ef service nova] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-a7ed24fe-1634-48a7-82d5-e79e90a84042 req-456bf7b0-b0f9-47f6-b023-9cc652c2d6ef service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] No waiting events found dispatching network-vif-plugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:56:53 user nova-compute[70869]: WARNING nova.compute.manager [req-a7ed24fe-1634-48a7-82d5-e79e90a84042 req-456bf7b0-b0f9-47f6-b023-9cc652c2d6ef service nova] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Received unexpected event network-vif-plugged-5c302ebb-2a5f-4549-942c-48075a0c4f4d for instance with vm_state active and task_state deleting.
Jul 25 15:56:53 user nova-compute[70869]: INFO nova.compute.manager [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Took 0.72 seconds to detach 1 volumes for instance.
Jul 25 15:56:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Deleting volume: aaf3b9d4-9b5b-4017-84c1-734b6785ef65 {{(pid=70869) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:56:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:53 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Deleted allocations for instance 97e013dd-a78a-4cc9-949e-ba2c810f973c
Jul 25 15:56:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ea88c736-df5b-4d5e-8deb-846a3edeea2e tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "97e013dd-a78a-4cc9-949e-ba2c810f973c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:56:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:56:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:56:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:56:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:06 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300611.521558, 97e013dd-a78a-4cc9-949e-ba2c810f973c => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:57:06 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] VM Stopped (Lifecycle Event)
Jul 25 15:57:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2107e3af-d3a5-4a0e-9223-0861cd506e27 None None] [instance: 97e013dd-a78a-4cc9-949e-ba2c810f973c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:57:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:57:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG nova.compute.manager [req-d59e1845-3319-40fa-bc80-3255fef672d6 req-6707f55d-fcc1-402a-8f2d-3aa2ec7fd062 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-changed-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG nova.compute.manager [req-d59e1845-3319-40fa-bc80-3255fef672d6 req-6707f55d-fcc1-402a-8f2d-3aa2ec7fd062 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Refreshing instance network info cache due to event network-changed-c0288dd3-2116-4c18-a4ca-73e0399ec75a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d59e1845-3319-40fa-bc80-3255fef672d6 req-6707f55d-fcc1-402a-8f2d-3aa2ec7fd062 service nova] Acquiring lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d59e1845-3319-40fa-bc80-3255fef672d6 req-6707f55d-fcc1-402a-8f2d-3aa2ec7fd062 service nova] Acquired lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG nova.network.neutron [req-d59e1845-3319-40fa-bc80-3255fef672d6 req-6707f55d-fcc1-402a-8f2d-3aa2ec7fd062 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Refreshing network info cache for port c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG nova.objects.instance [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'flavor' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:32 user nova-compute[70869]: INFO nova.compute.manager [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Attaching volume 9f98983e-79aa-4fa3-9704-42cb7ca6b64e to /dev/vdb
Jul 25 15:57:32 user nova-compute[70869]: DEBUG nova.network.neutron [req-d59e1845-3319-40fa-bc80-3255fef672d6 req-6707f55d-fcc1-402a-8f2d-3aa2ec7fd062 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updated VIF entry in instance network info cache for port c0288dd3-2116-4c18-a4ca-73e0399ec75a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG nova.network.neutron [req-d59e1845-3319-40fa-bc80-3255fef672d6 req-6707f55d-fcc1-402a-8f2d-3aa2ec7fd062 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating instance_info_cache with network_info: [{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d59e1845-3319-40fa-bc80-3255fef672d6 req-6707f55d-fcc1-402a-8f2d-3aa2ec7fd062 service nova] Releasing lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG os_brick.utils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[806bb24a-a7eb-40cf-89fc-8dcdac68b4fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca72d223-f327-401f-a0dc-afc50b032a6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66e65ef-5ff7-48b5-bdff-7af48fb46cdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d6db92-220c-4c05-a4d9-a19fb6c1443a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:57:32 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:57:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d1f87f-4118-45f3-8d60-ff28ccc1d6e8]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG os_brick.utils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:57:32 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating existing volume attachment record: 7d6937c8-9026-40ff-b1c2-c958add0cfeb {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:57:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'urDxaqFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:57:38 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:57:38 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:57:38 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5275e8d0-a5c1-4ab0-aabc-a96f829533d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:57:38 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26d5a85-5f44-440e-9512-dd9061061070]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e] added
Jul 25 15:57:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ed0495-f94c-49c8-a47b-6259e0ea8bb9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7430238-72b0-4cda-86c5-8f3419ca6dd5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v urDxaqFd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v urDxaqFd" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b837c5f1-10ee-4942-979b-fdd584b202ab]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'urDxaqFd'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51a872a-ebde-4809-9cc7-43c367d271fa]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5804534-dc80-4cb4-bbfc-e90954ab6e76]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 15:57:38 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 15:57:38 user nova-compute[70869]:  {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:57:38 user nova-compute[70869]: WARNING os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 15:57:38 user nova-compute[70869]: 
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcea0c8e-5858-4401-997b-f29153bc6e15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e, portal: 172.16.0.220,3260]
Jul 25 15:57:38 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e, portal: 172.16.0.220,3260] successful.
Jul 25 15:57:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6532b7f-bdef-48d3-afab-d18bd4db702e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[29531d40-9af0-4f28-8a8f-80bcb33e1f59]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:57:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:57:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[325779c4-fc95-4438-aefc-934415c53b21]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:57:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:57:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'urDxaqFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:57:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:57:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26134396238393166', 'path': '/dev/sdb'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:57:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134396238393166', 'path': '/dev/sdb'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:57:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'flavor' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:57:39 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:57:39 user nova-compute[70869]:   <source dev="/dev/sdb"/>
Jul 25 15:57:39 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:57:39 user nova-compute[70869]:   <serial>9f98983e-79aa-4fa3-9704-42cb7ca6b64e</serial>
Jul 25 15:57:39 user nova-compute[70869]: </disk>
Jul 25 15:57:39 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:57:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:57:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:57:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No VIF found with MAC fa:16:3e:8c:c9:d0, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:57:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-75b9c0f8-2c4e-4559-a527-27a2f8ea6219 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.461s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:40 user nova-compute[70869]: INFO nova.compute.manager [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Rescuing
Jul 25 15:57:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:57:40 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquired lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:57:40 user nova-compute[70869]: DEBUG nova.network.neutron [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG nova.network.neutron [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating instance_info_cache with network_info: [{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Releasing lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-1c841d0e-1843-4284-a35a-b216bb24a47c req-3f778510-62d3-4a59-a5df-4aa57ca70c9a service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-unplugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1c841d0e-1843-4284-a35a-b216bb24a47c req-3f778510-62d3-4a59-a5df-4aa57ca70c9a service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1c841d0e-1843-4284-a35a-b216bb24a47c req-3f778510-62d3-4a59-a5df-4aa57ca70c9a service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1c841d0e-1843-4284-a35a-b216bb24a47c req-3f778510-62d3-4a59-a5df-4aa57ca70c9a service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-1c841d0e-1843-4284-a35a-b216bb24a47c req-3f778510-62d3-4a59-a5df-4aa57ca70c9a service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-unplugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:57:41 user nova-compute[70869]: WARNING nova.compute.manager [req-1c841d0e-1843-4284-a35a-b216bb24a47c req-3f778510-62d3-4a59-a5df-4aa57ca70c9a service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-unplugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state active and task_state rescuing.
Jul 25 15:57:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Instance destroyed successfully.
Jul 25 15:57:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Attempting rescue
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70869) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Instance directory exists: not creating {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 25 15:57:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Creating image(s)
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue" returned: 0 in 0.052s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'migration_context' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Start _get_guest_xml network_info=[{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "vif_mac": "fa:16:3e:8c:c9:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'resources' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'numa_topology' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:42 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:57:42 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-559644806',display_name='tempest-ServerRescueNegativeTestJSON-server-559644806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-559644806',id=40,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI55a/pQOkt4Tpq7XzFSm0RXwMcragZEINMMx5bH6wRpqEvEt+C2XtIRdMumsJQPQfpcR4P41cr4GQZnzKTayL60NBWP94WnXczzsvLvFMheqv8lIDYmCgKAIWRJLX7JCA==',key_name='tempest-keypair-1296961173',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:55:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-d94ycp9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:55:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cee3181b38f451a929907b0250f7ae0',uuid=d1ecb257-072c-4d1c-b2c4-15486ae66936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "vif_mac": "fa:16:3e:8c:c9:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "vif_mac": "fa:16:3e:8c:c9:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0288dd3-2116-4c18-a4ca-73e0399ec75a,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0288dd3-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'pci_devices' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:57:42 user nova-compute[70869]:   <uuid>d1ecb257-072c-4d1c-b2c4-15486ae66936</uuid>
Jul 25 15:57:42 user nova-compute[70869]:   <name>instance-00000028</name>
Jul 25 15:57:42 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:57:42 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:57:42 user nova-compute[70869]:   <metadata>
Jul 25 15:57:42 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:57:42 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:57:42 user nova-compute[70869]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-559644806</nova:name>
Jul 25 15:57:42 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:57:42</nova:creationTime>
Jul 25 15:57:42 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:57:42 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:57:42 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:57:42 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:57:42 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:57:42 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:57:42 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:57:42 user nova-compute[70869]:       <nova:owner>
Jul 25 15:57:42 user nova-compute[70869]:         <nova:user uuid="2cee3181b38f451a929907b0250f7ae0">tempest-ServerRescueNegativeTestJSON-2116380302-project-member</nova:user>
Jul 25 15:57:42 user nova-compute[70869]:         <nova:project uuid="40a65674a8194f93a976d52353da0c39">tempest-ServerRescueNegativeTestJSON-2116380302</nova:project>
Jul 25 15:57:42 user nova-compute[70869]:       </nova:owner>
Jul 25 15:57:42 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:57:42 user nova-compute[70869]:       <nova:ports>
Jul 25 15:57:42 user nova-compute[70869]:         <nova:port uuid="c0288dd3-2116-4c18-a4ca-73e0399ec75a">
Jul 25 15:57:42 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 25 15:57:42 user nova-compute[70869]:         </nova:port>
Jul 25 15:57:42 user nova-compute[70869]:       </nova:ports>
Jul 25 15:57:42 user nova-compute[70869]:     </nova:instance>
Jul 25 15:57:42 user nova-compute[70869]:   </metadata>
Jul 25 15:57:42 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:57:42 user nova-compute[70869]:     <system>
Jul 25 15:57:42 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:57:42 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:57:42 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:57:42 user nova-compute[70869]:       <entry name="serial">d1ecb257-072c-4d1c-b2c4-15486ae66936</entry>
Jul 25 15:57:42 user nova-compute[70869]:       <entry name="uuid">d1ecb257-072c-4d1c-b2c4-15486ae66936</entry>
Jul 25 15:57:42 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:57:42 user nova-compute[70869]:     </system>
Jul 25 15:57:42 user nova-compute[70869]:   </sysinfo>
Jul 25 15:57:42 user nova-compute[70869]:   <os>
Jul 25 15:57:42 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:57:42 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:57:42 user nova-compute[70869]:   </os>
Jul 25 15:57:42 user nova-compute[70869]:   <features>
Jul 25 15:57:42 user nova-compute[70869]:     <acpi/>
Jul 25 15:57:42 user nova-compute[70869]:     <apic/>
Jul 25 15:57:42 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:57:42 user nova-compute[70869]:   </features>
Jul 25 15:57:42 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:57:42 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:57:42 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:57:42 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:57:42 user nova-compute[70869]:   </clock>
Jul 25 15:57:42 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:57:42 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:57:42 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:57:42 user nova-compute[70869]:   </cpu>
Jul 25 15:57:42 user nova-compute[70869]:   <devices>
Jul 25 15:57:42 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:57:42 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:57:42 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue"/>
Jul 25 15:57:42 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:57:42 user nova-compute[70869]:     </disk>
Jul 25 15:57:42 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:57:42 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:57:42 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk"/>
Jul 25 15:57:42 user nova-compute[70869]:       <target dev="vdb" bus="virtio"/>
Jul 25 15:57:42 user nova-compute[70869]:     </disk>
Jul 25 15:57:42 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:57:42 user nova-compute[70869]:       <mac address="fa:16:3e:8c:c9:d0"/>
Jul 25 15:57:42 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:57:42 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:57:42 user nova-compute[70869]:       <target dev="tapc0288dd3-21"/>
Jul 25 15:57:42 user nova-compute[70869]:     </interface>
Jul 25 15:57:42 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:57:42 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/console.log" append="off"/>
Jul 25 15:57:42 user nova-compute[70869]:     </serial>
Jul 25 15:57:42 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:57:42 user nova-compute[70869]:     <video>
Jul 25 15:57:42 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:57:42 user nova-compute[70869]:     </video>
Jul 25 15:57:42 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:57:42 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:57:42 user nova-compute[70869]:     </rng>
Jul 25 15:57:42 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:57:42 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:57:42 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:57:42 user nova-compute[70869]:     </memballoon>
Jul 25 15:57:42 user nova-compute[70869]:   </devices>
Jul 25 15:57:42 user nova-compute[70869]: </domain>
Jul 25 15:57:42 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:57:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Instance destroyed successfully.
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:57:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] No VIF found with MAC fa:16:3e:8c:c9:d0, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:57:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-f19c9750-e528-493f-9c7c-a91d117898e2 req-f3f5e404-339a-4060-96bf-fd2fe67bc257 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:57:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f19c9750-e528-493f-9c7c-a91d117898e2 req-f3f5e404-339a-4060-96bf-fd2fe67bc257 service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f19c9750-e528-493f-9c7c-a91d117898e2 req-f3f5e404-339a-4060-96bf-fd2fe67bc257 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f19c9750-e528-493f-9c7c-a91d117898e2 req-f3f5e404-339a-4060-96bf-fd2fe67bc257 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-f19c9750-e528-493f-9c7c-a91d117898e2 req-f3f5e404-339a-4060-96bf-fd2fe67bc257 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:57:43 user nova-compute[70869]: WARNING nova.compute.manager [req-f19c9750-e528-493f-9c7c-a91d117898e2 req-f3f5e404-339a-4060-96bf-fd2fe67bc257 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state active and task_state rescuing.
Jul 25 15:57:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:57:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:57:45 user nova-compute[70869]: WARNING nova.compute.manager [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state active and task_state rescuing.
Jul 25 15:57:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:57:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:57:45 user nova-compute[70869]: WARNING nova.compute.manager [req-f7db534b-9efa-410f-8fec-e306278dd9da req-3ccda376-e807-4a08-8c08-de25d08f6f06 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state active and task_state rescuing.
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for d1ecb257-072c-4d1c-b2c4-15486ae66936 due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300666.1191244, d1ecb257-072c-4d1c-b2c4-15486ae66936 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:57:46 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] VM Resumed (Lifecycle Event)
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-32bef691-b088-40de-b73c-9e1de655de01 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:57:46 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300666.121021, d1ecb257-072c-4d1c-b2c4-15486ae66936 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:57:46 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] VM Started (Lifecycle Event)
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:57:46 user nova-compute[70869]: INFO nova.compute.claims [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Claim successful on node user
Jul 25 15:57:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:57:46 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG nova.policy [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5652c0b752845cca61ba15971ef63fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcc8bf5793a4869bff694fb5bc8704f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:57:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:57:47 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Creating image(s)
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "/opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "/opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "/opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk 1073741824" returned: 0 in 0.054s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Successfully created port: ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Cannot resize image /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG nova.objects.instance [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'migration_context' on Instance uuid 45fb4262-b025-4455-b3ac-4c1909c4d1ef {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Ensure instance console log exists: /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Successfully updated port: ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "refresh_cache-45fb4262-b025-4455-b3ac-4c1909c4d1ef" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquired lock "refresh_cache-45fb4262-b025-4455-b3ac-4c1909c4d1ef" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG nova.compute.manager [req-a3442242-71bb-4007-b082-2c4e65feb932 req-537e3332-6bba-4e0d-8a67-a7c68804b22f service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-changed-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG nova.compute.manager [req-a3442242-71bb-4007-b082-2c4e65feb932 req-537e3332-6bba-4e0d-8a67-a7c68804b22f service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Refreshing instance network info cache due to event network-changed-ea89090c-ff7a-4492-81bd-0d948d382c03. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a3442242-71bb-4007-b082-2c4e65feb932 req-537e3332-6bba-4e0d-8a67-a7c68804b22f service nova] Acquiring lock "refresh_cache-45fb4262-b025-4455-b3ac-4c1909c4d1ef" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue --force-share --output=json" returned: 0 in 0.361s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Updating instance_info_cache with network_info: [{"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Releasing lock "refresh_cache-45fb4262-b025-4455-b3ac-4c1909c4d1ef" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Instance network_info: |[{"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a3442242-71bb-4007-b082-2c4e65feb932 req-537e3332-6bba-4e0d-8a67-a7c68804b22f service nova] Acquired lock "refresh_cache-45fb4262-b025-4455-b3ac-4c1909c4d1ef" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.network.neutron [req-a3442242-71bb-4007-b082-2c4e65feb932 req-537e3332-6bba-4e0d-8a67-a7c68804b22f service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Refreshing network info cache for port ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Start _get_guest_xml network_info=[{"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:57:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:57:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1346132266',display_name='tempest-VolumesSnapshotTestJSON-instance-1346132266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1346132266',id=43,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLz4w+ft0EHX/46YL4uR9CV31lPEpe0Jvp9MHAFiJIASuXNZcmmjnzgUQ/vMX0LiXdm0oPK0h6jpjB8qYC2HlR97BRh9bwOuvbsxi+CLmyxzLKdnn4MoCn9IjpHBRWCRg==',key_name='tempest-keypair-798198216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edcc8bf5793a4869bff694fb5bc8704f',ramdisk_id='',reservation_id='r-e5fizdl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-529637024',owner_user_name='tempest-VolumesSnapshotTestJSON-529637024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5652c0b752845cca61ba15971ef63fe',uuid=45fb4262-b025-4455-b3ac-4c1909c4d1ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converting VIF {"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:4f:84,bridge_name='br-int',has_traffic_filtering=True,id=ea89090c-ff7a-4492-81bd-0d948d382c03,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea89090c-ff') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.objects.instance [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'pci_devices' on Instance uuid 45fb4262-b025-4455-b3ac-4c1909c4d1ef {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:57:49 user nova-compute[70869]:   <uuid>45fb4262-b025-4455-b3ac-4c1909c4d1ef</uuid>
Jul 25 15:57:49 user nova-compute[70869]:   <name>instance-0000002b</name>
Jul 25 15:57:49 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:57:49 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:57:49 user nova-compute[70869]:   <metadata>
Jul 25 15:57:49 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:57:49 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:57:49 user nova-compute[70869]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1346132266</nova:name>
Jul 25 15:57:49 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:57:49</nova:creationTime>
Jul 25 15:57:49 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:57:49 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:57:49 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:57:49 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:57:49 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:57:49 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:57:49 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:57:49 user nova-compute[70869]:       <nova:owner>
Jul 25 15:57:49 user nova-compute[70869]:         <nova:user uuid="c5652c0b752845cca61ba15971ef63fe">tempest-VolumesSnapshotTestJSON-529637024-project-member</nova:user>
Jul 25 15:57:49 user nova-compute[70869]:         <nova:project uuid="edcc8bf5793a4869bff694fb5bc8704f">tempest-VolumesSnapshotTestJSON-529637024</nova:project>
Jul 25 15:57:49 user nova-compute[70869]:       </nova:owner>
Jul 25 15:57:49 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:57:49 user nova-compute[70869]:       <nova:ports>
Jul 25 15:57:49 user nova-compute[70869]:         <nova:port uuid="ea89090c-ff7a-4492-81bd-0d948d382c03">
Jul 25 15:57:49 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 25 15:57:49 user nova-compute[70869]:         </nova:port>
Jul 25 15:57:49 user nova-compute[70869]:       </nova:ports>
Jul 25 15:57:49 user nova-compute[70869]:     </nova:instance>
Jul 25 15:57:49 user nova-compute[70869]:   </metadata>
Jul 25 15:57:49 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:57:49 user nova-compute[70869]:     <system>
Jul 25 15:57:49 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:57:49 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:57:49 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:57:49 user nova-compute[70869]:       <entry name="serial">45fb4262-b025-4455-b3ac-4c1909c4d1ef</entry>
Jul 25 15:57:49 user nova-compute[70869]:       <entry name="uuid">45fb4262-b025-4455-b3ac-4c1909c4d1ef</entry>
Jul 25 15:57:49 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:57:49 user nova-compute[70869]:     </system>
Jul 25 15:57:49 user nova-compute[70869]:   </sysinfo>
Jul 25 15:57:49 user nova-compute[70869]:   <os>
Jul 25 15:57:49 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:57:49 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:57:49 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:57:49 user nova-compute[70869]:   </os>
Jul 25 15:57:49 user nova-compute[70869]:   <features>
Jul 25 15:57:49 user nova-compute[70869]:     <acpi/>
Jul 25 15:57:49 user nova-compute[70869]:     <apic/>
Jul 25 15:57:49 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:57:49 user nova-compute[70869]:   </features>
Jul 25 15:57:49 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:57:49 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:57:49 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:57:49 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:57:49 user nova-compute[70869]:   </clock>
Jul 25 15:57:49 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:57:49 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:57:49 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:57:49 user nova-compute[70869]:   </cpu>
Jul 25 15:57:49 user nova-compute[70869]:   <devices>
Jul 25 15:57:49 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:57:49 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:57:49 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk"/>
Jul 25 15:57:49 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:57:49 user nova-compute[70869]:     </disk>
Jul 25 15:57:49 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:57:49 user nova-compute[70869]:       <mac address="fa:16:3e:67:4f:84"/>
Jul 25 15:57:49 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:57:49 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:57:49 user nova-compute[70869]:       <target dev="tapea89090c-ff"/>
Jul 25 15:57:49 user nova-compute[70869]:     </interface>
Jul 25 15:57:49 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:57:49 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/console.log" append="off"/>
Jul 25 15:57:49 user nova-compute[70869]:     </serial>
Jul 25 15:57:49 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:57:49 user nova-compute[70869]:     <video>
Jul 25 15:57:49 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:57:49 user nova-compute[70869]:     </video>
Jul 25 15:57:49 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:57:49 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:57:49 user nova-compute[70869]:     </rng>
Jul 25 15:57:49 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:57:49 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:57:49 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:57:49 user nova-compute[70869]:     </memballoon>
Jul 25 15:57:49 user nova-compute[70869]:   </devices>
Jul 25 15:57:49 user nova-compute[70869]: </domain>
Jul 25 15:57:49 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1346132266',display_name='tempest-VolumesSnapshotTestJSON-instance-1346132266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1346132266',id=43,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLz4w+ft0EHX/46YL4uR9CV31lPEpe0Jvp9MHAFiJIASuXNZcmmjnzgUQ/vMX0LiXdm0oPK0h6jpjB8qYC2HlR97BRh9bwOuvbsxi+CLmyxzLKdnn4MoCn9IjpHBRWCRg==',key_name='tempest-keypair-798198216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edcc8bf5793a4869bff694fb5bc8704f',ramdisk_id='',reservation_id='r-e5fizdl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-529637024',owner_user_name='tempest-VolumesSnapshotTestJSON-529637024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5652c0b752845cca61ba15971ef63fe',uuid=45fb4262-b025-4455-b3ac-4c1909c4d1ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converting VIF {"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:4f:84,bridge_name='br-int',has_traffic_filtering=True,id=ea89090c-ff7a-4492-81bd-0d948d382c03,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea89090c-ff') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG os_vif [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:4f:84,bridge_name='br-int',has_traffic_filtering=True,id=ea89090c-ff7a-4492-81bd-0d948d382c03,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea89090c-ff') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea89090c-ff, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea89090c-ff, col_values=(('external_ids', {'iface-id': 'ea89090c-ff7a-4492-81bd-0d948d382c03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:4f:84', 'vm-uuid': '45fb4262-b025-4455-b3ac-4c1909c4d1ef'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:49 user nova-compute[70869]: INFO os_vif [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:4f:84,bridge_name='br-int',has_traffic_filtering=True,id=ea89090c-ff7a-4492-81bd-0d948d382c03,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea89090c-ff')
Jul 25 15:57:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:57:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:57:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8164MB free_disk=25.183074951171875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No VIF found with MAC fa:16:3e:67:4f:84, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-a3442242-71bb-4007-b082-2c4e65feb932 req-537e3332-6bba-4e0d-8a67-a7c68804b22f service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Updated VIF entry in instance network info cache for port ea89090c-ff7a-4492-81bd-0d948d382c03. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-a3442242-71bb-4007-b082-2c4e65feb932 req-537e3332-6bba-4e0d-8a67-a7c68804b22f service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Updating instance_info_cache with network_info: [{"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-a3442242-71bb-4007-b082-2c4e65feb932 req-537e3332-6bba-4e0d-8a67-a7c68804b22f service nova] Releasing lock "refresh_cache-45fb4262-b025-4455-b3ac-4c1909c4d1ef" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 263aedd4-9dbd-4232-986a-e250505153e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d1ecb257-072c-4d1c-b2c4-15486ae66936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 835a1495-de8c-4649-a4ef-266be7914aa6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 199a97cd-a3b3-4711-88dc-ab4239f996fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 45fb4262-b025-4455-b3ac-4c1909c4d1ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing inventories for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating ProviderTree inventory for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing aggregate associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, aggregates: None {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Refreshing trait associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41 {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.820s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances with incomplete migration  {{(pid=70869) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:57:51 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-36a8bb5c-916a-436d-a091-4dd4d139a916 req-c2427b6e-6825-471b-ad2e-ef98e9c18b32 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:57:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-36a8bb5c-916a-436d-a091-4dd4d139a916 req-c2427b6e-6825-471b-ad2e-ef98e9c18b32 service nova] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-36a8bb5c-916a-436d-a091-4dd4d139a916 req-c2427b6e-6825-471b-ad2e-ef98e9c18b32 service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-36a8bb5c-916a-436d-a091-4dd4d139a916 req-c2427b6e-6825-471b-ad2e-ef98e9c18b32 service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:52 user nova-compute[70869]: DEBUG nova.compute.manager [req-36a8bb5c-916a-436d-a091-4dd4d139a916 req-c2427b6e-6825-471b-ad2e-ef98e9c18b32 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] No waiting events found dispatching network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:57:52 user nova-compute[70869]: WARNING nova.compute.manager [req-36a8bb5c-916a-436d-a091-4dd4d139a916 req-c2427b6e-6825-471b-ad2e-ef98e9c18b32 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received unexpected event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 for instance with vm_state building and task_state spawning.
Jul 25 15:57:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300673.7369401, 45fb4262-b025-4455-b3ac-4c1909c4d1ef => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:57:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] VM Resumed (Lifecycle Event)
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:57:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Instance spawned successfully.
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:57:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300673.73985, 45fb4262-b025-4455-b3ac-4c1909c4d1ef => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:57:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] VM Started (Lifecycle Event)
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:57:53 user nova-compute[70869]: INFO nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Took 6.83 seconds to spawn the instance on the hypervisor.
Jul 25 15:57:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:57:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:57:53 user nova-compute[70869]: INFO nova.compute.manager [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Took 7.61 seconds to build instance.
Jul 25 15:57:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-632aba35-8f9e-45c4-9677-1f189045465d tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.695s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-9269a33a-a2c5-4751-8e73-2d2601975ff2 req-1cfbad28-efe8-43b6-baa7-5d334388a2f3 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:57:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9269a33a-a2c5-4751-8e73-2d2601975ff2 req-1cfbad28-efe8-43b6-baa7-5d334388a2f3 service nova] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9269a33a-a2c5-4751-8e73-2d2601975ff2 req-1cfbad28-efe8-43b6-baa7-5d334388a2f3 service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9269a33a-a2c5-4751-8e73-2d2601975ff2 req-1cfbad28-efe8-43b6-baa7-5d334388a2f3 service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:54 user nova-compute[70869]: DEBUG nova.compute.manager [req-9269a33a-a2c5-4751-8e73-2d2601975ff2 req-1cfbad28-efe8-43b6-baa7-5d334388a2f3 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] No waiting events found dispatching network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:57:54 user nova-compute[70869]: WARNING nova.compute.manager [req-9269a33a-a2c5-4751-8e73-2d2601975ff2 req-1cfbad28-efe8-43b6-baa7-5d334388a2f3 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received unexpected event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 for instance with vm_state active and task_state None.
Jul 25 15:57:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:57:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:57:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:57:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:57:57 user nova-compute[70869]: INFO nova.compute.claims [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Claim successful on node user
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-e0f42e3b-14e3-44c6-a000-9d957f245bfd req-7061f6e3-3fd2-4b94-8f6b-85a04c578fc4 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received event network-changed-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.compute.manager [req-e0f42e3b-14e3-44c6-a000-9d957f245bfd req-7061f6e3-3fd2-4b94-8f6b-85a04c578fc4 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Refreshing instance network info cache due to event network-changed-5496ed94-107b-47ab-8c7a-6fb636ec7d5a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e0f42e3b-14e3-44c6-a000-9d957f245bfd req-7061f6e3-3fd2-4b94-8f6b-85a04c578fc4 service nova] Acquiring lock "refresh_cache-835a1495-de8c-4649-a4ef-266be7914aa6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e0f42e3b-14e3-44c6-a000-9d957f245bfd req-7061f6e3-3fd2-4b94-8f6b-85a04c578fc4 service nova] Acquired lock "refresh_cache-835a1495-de8c-4649-a4ef-266be7914aa6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-e0f42e3b-14e3-44c6-a000-9d957f245bfd req-7061f6e3-3fd2-4b94-8f6b-85a04c578fc4 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Refreshing network info cache for port 5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.network.neutron [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:57:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-e0f42e3b-14e3-44c6-a000-9d957f245bfd req-7061f6e3-3fd2-4b94-8f6b-85a04c578fc4 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Updated VIF entry in instance network info cache for port 5496ed94-107b-47ab-8c7a-6fb636ec7d5a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.network.neutron [req-e0f42e3b-14e3-44c6-a000-9d957f245bfd req-7061f6e3-3fd2-4b94-8f6b-85a04c578fc4 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Updating instance_info_cache with network_info: [{"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:57:58 user nova-compute[70869]: INFO nova.virt.block_device [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Booting with volume 4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e at /dev/vda
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.policy [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f175a95c6c4e43b4b7d1910419070bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d4fe99fc224a2686f2f3daf32ecbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e0f42e3b-14e3-44c6-a000-9d957f245bfd req-7061f6e3-3fd2-4b94-8f6b-85a04c578fc4 service nova] Releasing lock "refresh_cache-835a1495-de8c-4649-a4ef-266be7914aa6" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG os_brick.utils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eef3a83-a798-4696-a2ca-a3defe1201bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfc301c-a699-4241-bdef-7e24e8f072d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26dc2ae-6453-4bf7-9b88-250a5e577895]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[74117795-fe0c-496e-a506-6a1239666a48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] There are 0 instances to clean {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:57:58 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:57:58 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d0548d-51b5-4681-8959-4875aa84ed92]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG os_brick.utils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:57:58 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Updating existing volume attachment record: 97db298a-a624-485d-b9d0-08ca41f27023 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:57:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:57:59 user nova-compute[70869]: DEBUG nova.network.neutron [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Successfully created port: ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:57:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Successfully updated port: ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquired lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-981f6799-4e5f-4a31-80c5-417073113382 req-5ede8a24-c571-4690-8bb2-b82161662faf service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received event network-changed-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG nova.compute.manager [req-981f6799-4e5f-4a31-80c5-417073113382 req-5ede8a24-c571-4690-8bb2-b82161662faf service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Refreshing instance network info cache due to event network-changed-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-981f6799-4e5f-4a31-80c5-417073113382 req-5ede8a24-c571-4690-8bb2-b82161662faf service nova] Acquiring lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Updating instance_info_cache with network_info: [{"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Releasing lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Instance network_info: |[{"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-981f6799-4e5f-4a31-80c5-417073113382 req-5ede8a24-c571-4690-8bb2-b82161662faf service nova] Acquired lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG nova.network.neutron [req-981f6799-4e5f-4a31-80c5-417073113382 req-5ede8a24-c571-4690-8bb2-b82161662faf service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Refreshing network info cache for port ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:58:00 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:01 user nova-compute[70869]: DEBUG nova.network.neutron [req-981f6799-4e5f-4a31-80c5-417073113382 req-5ede8a24-c571-4690-8bb2-b82161662faf service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Updated VIF entry in instance network info cache for port ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:58:01 user nova-compute[70869]: DEBUG nova.network.neutron [req-981f6799-4e5f-4a31-80c5-417073113382 req-5ede8a24-c571-4690-8bb2-b82161662faf service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Updating instance_info_cache with network_info: [{"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:58:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-981f6799-4e5f-4a31-80c5-417073113382 req-5ede8a24-c571-4690-8bb2-b82161662faf service nova] Releasing lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'flavor' on Instance uuid 835a1495-de8c-4649-a4ef-266be7914aa6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:04 user nova-compute[70869]: INFO nova.compute.manager [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Attaching volume 53bb1859-642d-413d-b07e-1fbca16949d2 to /dev/vdb
Jul 25 15:58:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG os_brick.utils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8d95f8-8dd0-41af-8811-086b674d8964]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0869e1d8-ac9b-41d7-80e8-c93169221e4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0844ea16-d90b-4271-bc17-b65fae832823]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b440f65e-0a3c-4333-9b29-c55018bdf503]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:58:04 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:58:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f75c681-5553-451f-a1c9-bda84d34a101]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG os_brick.utils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:58:04 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Updating existing volume attachment record: 7959cd26-38f9-4f0a-9ca7-61eb46e87327 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:58:06 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:58:07 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Creating image(s)
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Ensure instance console log exists: /opt/stack/data/nova/instances/a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Start _get_guest_xml network_info=[{"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '97db298a-a624-485d-b9d0-08ca41f27023', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NioLGMDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1', 'attached_at': '', 'detached_at': '', 'volume_id': '4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e', 'serial': '4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e'}, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:58:07 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:58:07 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NioLGMDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:58:07 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:58:07 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:58:07 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d350c9-ee2d-4f47-a271-be98566f3d70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:58:07 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[202360b2-ffab-43dd-bb9c-20fb85293b82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e] added
Jul 25 15:58:07 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e104854-0a3a-4b25-8f49-44a6ff6b9acb]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d504b56c-a0e3-4b1a-8bdc-9b3cf4cad5ba]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NioLGMDJ {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NioLGMDJ" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73fe6ea-3067-42df-b785-1bacd657e936]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NioLGMDJ'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d606e03-e5ec-45ed-aeb3-3f91c2ae114f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3e6bde-a12f-4087-87e7-02d7ca0c8ad3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:07 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:07 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d52c3f-71dc-4c7e-8127-2003c392ff7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e, portal: 172.16.0.220,3260]
Jul 25 15:58:07 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e, portal: 172.16.0.220,3260] successful.
Jul 25 15:58:07 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08d4742-54f0-4c4e-9b39-2acb4cad6107]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[46768eb4-1ec3-4bc6-8d4f-b1e324bdc958]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:07 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:07 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:07 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:07 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04cf2ff-406c-47bf-995e-e8a7e5b72f3a]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:58:07 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NioLGMDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23339666133653066', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339666133653066', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1782369048',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1782369048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1782369048',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFrTMnqYzDpEuWOuJdm17DzcmrI2QG8Dl1cArokkmeww9RqsPCf5kzM+q9sh6MJwkWGrzUQJc6w60R44VGJo09JfT6mkgmHQ2dkjXHpSasifkz/KmCeMX7t39GCJSeSgg==',key_name='tempest-keypair-168928722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-dsjd9ggg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a2:9d,bridge_name='br-int',has_traffic_filtering=True,id=ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac12f13f-9c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.objects.instance [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'pci_devices' on Instance uuid a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:58:08 user nova-compute[70869]:   <uuid>a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1</uuid>
Jul 25 15:58:08 user nova-compute[70869]:   <name>instance-0000002c</name>
Jul 25 15:58:08 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:58:08 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:58:08 user nova-compute[70869]:   <metadata>
Jul 25 15:58:08 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:58:08 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:58:08 user nova-compute[70869]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1782369048</nova:name>
Jul 25 15:58:08 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:58:07</nova:creationTime>
Jul 25 15:58:08 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:58:08 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:58:08 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:58:08 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:58:08 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:58:08 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:58:08 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:58:08 user nova-compute[70869]:       <nova:owner>
Jul 25 15:58:08 user nova-compute[70869]:         <nova:user uuid="f175a95c6c4e43b4b7d1910419070bf7">tempest-TestVolumeBootPattern-1492727042-project-member</nova:user>
Jul 25 15:58:08 user nova-compute[70869]:         <nova:project uuid="a0d4fe99fc224a2686f2f3daf32ecbd5">tempest-TestVolumeBootPattern-1492727042</nova:project>
Jul 25 15:58:08 user nova-compute[70869]:       </nova:owner>
Jul 25 15:58:08 user nova-compute[70869]:       <nova:ports>
Jul 25 15:58:08 user nova-compute[70869]:         <nova:port uuid="ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6">
Jul 25 15:58:08 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 25 15:58:08 user nova-compute[70869]:         </nova:port>
Jul 25 15:58:08 user nova-compute[70869]:       </nova:ports>
Jul 25 15:58:08 user nova-compute[70869]:     </nova:instance>
Jul 25 15:58:08 user nova-compute[70869]:   </metadata>
Jul 25 15:58:08 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:58:08 user nova-compute[70869]:     <system>
Jul 25 15:58:08 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:58:08 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:58:08 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:58:08 user nova-compute[70869]:       <entry name="serial">a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1</entry>
Jul 25 15:58:08 user nova-compute[70869]:       <entry name="uuid">a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1</entry>
Jul 25 15:58:08 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:58:08 user nova-compute[70869]:     </system>
Jul 25 15:58:08 user nova-compute[70869]:   </sysinfo>
Jul 25 15:58:08 user nova-compute[70869]:   <os>
Jul 25 15:58:08 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:58:08 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:58:08 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:58:08 user nova-compute[70869]:   </os>
Jul 25 15:58:08 user nova-compute[70869]:   <features>
Jul 25 15:58:08 user nova-compute[70869]:     <acpi/>
Jul 25 15:58:08 user nova-compute[70869]:     <apic/>
Jul 25 15:58:08 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:58:08 user nova-compute[70869]:   </features>
Jul 25 15:58:08 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:58:08 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:58:08 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:58:08 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:58:08 user nova-compute[70869]:   </clock>
Jul 25 15:58:08 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:58:08 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:58:08 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:58:08 user nova-compute[70869]:   </cpu>
Jul 25 15:58:08 user nova-compute[70869]:   <devices>
Jul 25 15:58:08 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 15:58:08 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:58:08 user nova-compute[70869]:       <source dev="/dev/sdc"/>
Jul 25 15:58:08 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:58:08 user nova-compute[70869]:       <serial>4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e</serial>
Jul 25 15:58:08 user nova-compute[70869]:     </disk>
Jul 25 15:58:08 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:58:08 user nova-compute[70869]:       <mac address="fa:16:3e:8d:a2:9d"/>
Jul 25 15:58:08 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:58:08 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:58:08 user nova-compute[70869]:       <target dev="tapac12f13f-9c"/>
Jul 25 15:58:08 user nova-compute[70869]:     </interface>
Jul 25 15:58:08 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:58:08 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1/console.log" append="off"/>
Jul 25 15:58:08 user nova-compute[70869]:     </serial>
Jul 25 15:58:08 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:58:08 user nova-compute[70869]:     <video>
Jul 25 15:58:08 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:58:08 user nova-compute[70869]:     </video>
Jul 25 15:58:08 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:58:08 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:58:08 user nova-compute[70869]:     </rng>
Jul 25 15:58:08 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:58:08 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:58:08 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:58:08 user nova-compute[70869]:     </memballoon>
Jul 25 15:58:08 user nova-compute[70869]:   </devices>
Jul 25 15:58:08 user nova-compute[70869]: </domain>
Jul 25 15:58:08 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1782369048',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1782369048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1782369048',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFrTMnqYzDpEuWOuJdm17DzcmrI2QG8Dl1cArokkmeww9RqsPCf5kzM+q9sh6MJwkWGrzUQJc6w60R44VGJo09JfT6mkgmHQ2dkjXHpSasifkz/KmCeMX7t39GCJSeSgg==',key_name='tempest-keypair-168928722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-dsjd9ggg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a2:9d,bridge_name='br-int',has_traffic_filtering=True,id=ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac12f13f-9c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG os_vif [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a2:9d,bridge_name='br-int',has_traffic_filtering=True,id=ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac12f13f-9c') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac12f13f-9c, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac12f13f-9c, col_values=(('external_ids', {'iface-id': 'ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:a2:9d', 'vm-uuid': 'a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:08 user nova-compute[70869]: INFO os_vif [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a2:9d,bridge_name='br-int',has_traffic_filtering=True,id=ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac12f13f-9c')
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:58:08 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No VIF found with MAC fa:16:3e:8d:a2:9d, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:58:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-12fd6462-ecc4-4982-96cc-fc5a072de351 req-f55ab7f9-583e-4397-9f0f-f1aecb26cea3 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received event network-vif-plugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-12fd6462-ecc4-4982-96cc-fc5a072de351 req-f55ab7f9-583e-4397-9f0f-f1aecb26cea3 service nova] Acquiring lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-12fd6462-ecc4-4982-96cc-fc5a072de351 req-f55ab7f9-583e-4397-9f0f-f1aecb26cea3 service nova] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-12fd6462-ecc4-4982-96cc-fc5a072de351 req-f55ab7f9-583e-4397-9f0f-f1aecb26cea3 service nova] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-12fd6462-ecc4-4982-96cc-fc5a072de351 req-f55ab7f9-583e-4397-9f0f-f1aecb26cea3 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] No waiting events found dispatching network-vif-plugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:58:10 user nova-compute[70869]: WARNING nova.compute.manager [req-12fd6462-ecc4-4982-96cc-fc5a072de351 req-f55ab7f9-583e-4397-9f0f-f1aecb26cea3 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received unexpected event network-vif-plugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 for instance with vm_state building and task_state spawning.
Jul 25 15:58:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300692.4267824, a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:58:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] VM Resumed (Lifecycle Event)
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:58:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Instance spawned successfully.
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300692.4282486, a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:58:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] VM Started (Lifecycle Event)
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:58:12 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-c3f83bc1-d0c1-4f05-bc4a-1c376df35f02 req-526ae97d-c4d3-4999-9f99-3ba63960268b service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received event network-vif-plugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c3f83bc1-d0c1-4f05-bc4a-1c376df35f02 req-526ae97d-c4d3-4999-9f99-3ba63960268b service nova] Acquiring lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c3f83bc1-d0c1-4f05-bc4a-1c376df35f02 req-526ae97d-c4d3-4999-9f99-3ba63960268b service nova] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c3f83bc1-d0c1-4f05-bc4a-1c376df35f02 req-526ae97d-c4d3-4999-9f99-3ba63960268b service nova] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-c3f83bc1-d0c1-4f05-bc4a-1c376df35f02 req-526ae97d-c4d3-4999-9f99-3ba63960268b service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] No waiting events found dispatching network-vif-plugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:58:12 user nova-compute[70869]: WARNING nova.compute.manager [req-c3f83bc1-d0c1-4f05-bc4a-1c376df35f02 req-526ae97d-c4d3-4999-9f99-3ba63960268b service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received unexpected event network-vif-plugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 for instance with vm_state building and task_state spawning.
Jul 25 15:58:12 user nova-compute[70869]: INFO nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Took 5.07 seconds to spawn the instance on the hypervisor.
Jul 25 15:58:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:58:12 user nova-compute[70869]: INFO nova.compute.manager [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Took 14.68 seconds to build instance.
Jul 25 15:58:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-866e7e46-dbf5-4bd3-9435-271c05bbc0fa tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.806s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVrKalqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:58:13 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:58:13 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:58:13 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[da34720b-aecf-4dd7-a7b8-30a7ade0cf5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:58:13 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[94431975-5ab2-428d-ae14-d324fb68f5c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2] added
Jul 25 15:58:13 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb01131-02ad-4a82-8220-4699b77233f5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2e2a09-987d-434d-8eb0-fde9a8dbaa77]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVrKalqb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVrKalqb" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace1003d-0989-45fe-b783-f5fd6d4cc64e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UVrKalqb'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e9aa16-5875-414a-b743-569d72041b49]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1178d8-9c71-43f6-ac28-0000b098a8c9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:13 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:13 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:13 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:13 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d0658a-ba46-457d-ac98-02327859ee6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2, portal: 172.16.0.220,3260]
Jul 25 15:58:13 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2, portal: 172.16.0.220,3260] successful.
Jul 25 15:58:13 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c42683-c46c-472f-9bf2-7152dcbbae69]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a203b5b-cb41-43d9-a809-7a98e0c733a6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:13 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:13 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:58:13 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:13 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:13 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:58:13 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a743881-141f-449c-940a-5f2b77b86666]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:58:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:14 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:58:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVrKalqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:58:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:58:14 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23761326130653262', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:58:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761326130653262', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:58:14 user nova-compute[70869]: DEBUG nova.objects.instance [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'flavor' on Instance uuid 835a1495-de8c-4649-a4ef-266be7914aa6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:58:14 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:58:14 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:58:14 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 15:58:14 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:58:14 user nova-compute[70869]:   <serial>53bb1859-642d-413d-b07e-1fbca16949d2</serial>
Jul 25 15:58:14 user nova-compute[70869]: </disk>
Jul 25 15:58:14 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:58:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:58:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:58:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No VIF found with MAC fa:16:3e:c5:32:c8, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:58:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-e82bb5a4-93dd-4513-b82b-6b942d945958 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.995s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:18 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:58:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:18 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:18 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:58:18 user nova-compute[70869]: INFO nova.compute.claims [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Claim successful on node user
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.network.neutron [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:58:19 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.policy [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41de05146fc5424a9f4b4852a3739135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bbd6a3baf146179b81bda84bdd466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 15:58:19 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Creating image(s)
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "/opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "/opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "/opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk 1073741824" returned: 0 in 0.057s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 15:58:19 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Cannot resize image /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'migration_context' on Instance uuid bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Successfully created port: ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Ensure instance console log exists: /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Successfully updated port: ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "refresh_cache-bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquired lock "refresh_cache-bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG nova.network.neutron [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-922c5c2c-4ef0-47c8-81cf-967f25982a7c req-42c030bd-79b8-4705-89e3-69f732e3553f service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received event network-changed-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG nova.compute.manager [req-922c5c2c-4ef0-47c8-81cf-967f25982a7c req-42c030bd-79b8-4705-89e3-69f732e3553f service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Refreshing instance network info cache due to event network-changed-ed92dc75-b5d9-4bd5-8838-6205adf9349e. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:58:20 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-922c5c2c-4ef0-47c8-81cf-967f25982a7c req-42c030bd-79b8-4705-89e3-69f732e3553f service nova] Acquiring lock "refresh_cache-bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.network.neutron [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Updating instance_info_cache with network_info: [{"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Releasing lock "refresh_cache-bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Instance network_info: |[{"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-922c5c2c-4ef0-47c8-81cf-967f25982a7c req-42c030bd-79b8-4705-89e3-69f732e3553f service nova] Acquired lock "refresh_cache-bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-922c5c2c-4ef0-47c8-81cf-967f25982a7c req-42c030bd-79b8-4705-89e3-69f732e3553f service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Refreshing network info cache for port ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Start _get_guest_xml network_info=[{"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 15:58:21 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:58:21 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1402637286',display_name='tempest-AttachVolumeNegativeTest-server-1402637286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1402637286',id=45,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORR+OxhJ8NHl9CItMMjkv4fLTWxFj3JYC9taxNsxbTpqPxUcG0CdgAov6tMb5yDDp7fEX7ESeWuLaNRKa6eeRIu3uB2wWoHanOesE+mKma7RJnROwzx20teyQLDI1XWkQ==',key_name='tempest-keypair-1693537147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-ea1n8mhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:58:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=bec5046f-9ed2-4813-8ab2-b2a61d37b2e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=ed92dc75-b5d9-4bd5-8838-6205adf9349e,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped92dc75-b5') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'pci_devices' on Instance uuid bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] End _get_guest_xml xml=<domain type="kvm">
Jul 25 15:58:21 user nova-compute[70869]:   <uuid>bec5046f-9ed2-4813-8ab2-b2a61d37b2e5</uuid>
Jul 25 15:58:21 user nova-compute[70869]:   <name>instance-0000002d</name>
Jul 25 15:58:21 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 15:58:21 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 15:58:21 user nova-compute[70869]:   <metadata>
Jul 25 15:58:21 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 15:58:21 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 15:58:21 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1402637286</nova:name>
Jul 25 15:58:21 user nova-compute[70869]:       <nova:creationTime>2023-07-25 15:58:21</nova:creationTime>
Jul 25 15:58:21 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 15:58:21 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 15:58:21 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 15:58:21 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 15:58:21 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 15:58:21 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 15:58:21 user nova-compute[70869]:       </nova:flavor>
Jul 25 15:58:21 user nova-compute[70869]:       <nova:owner>
Jul 25 15:58:21 user nova-compute[70869]:         <nova:user uuid="41de05146fc5424a9f4b4852a3739135">tempest-AttachVolumeNegativeTest-1624272753-project-member</nova:user>
Jul 25 15:58:21 user nova-compute[70869]:         <nova:project uuid="82bbd6a3baf146179b81bda84bdd466a">tempest-AttachVolumeNegativeTest-1624272753</nova:project>
Jul 25 15:58:21 user nova-compute[70869]:       </nova:owner>
Jul 25 15:58:21 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 15:58:21 user nova-compute[70869]:       <nova:ports>
Jul 25 15:58:21 user nova-compute[70869]:         <nova:port uuid="ed92dc75-b5d9-4bd5-8838-6205adf9349e">
Jul 25 15:58:21 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 25 15:58:21 user nova-compute[70869]:         </nova:port>
Jul 25 15:58:21 user nova-compute[70869]:       </nova:ports>
Jul 25 15:58:21 user nova-compute[70869]:     </nova:instance>
Jul 25 15:58:21 user nova-compute[70869]:   </metadata>
Jul 25 15:58:21 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 15:58:21 user nova-compute[70869]:     <system>
Jul 25 15:58:21 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 15:58:21 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 15:58:21 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 15:58:21 user nova-compute[70869]:       <entry name="serial">bec5046f-9ed2-4813-8ab2-b2a61d37b2e5</entry>
Jul 25 15:58:21 user nova-compute[70869]:       <entry name="uuid">bec5046f-9ed2-4813-8ab2-b2a61d37b2e5</entry>
Jul 25 15:58:21 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 15:58:21 user nova-compute[70869]:     </system>
Jul 25 15:58:21 user nova-compute[70869]:   </sysinfo>
Jul 25 15:58:21 user nova-compute[70869]:   <os>
Jul 25 15:58:21 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 15:58:21 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 15:58:21 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 15:58:21 user nova-compute[70869]:   </os>
Jul 25 15:58:21 user nova-compute[70869]:   <features>
Jul 25 15:58:21 user nova-compute[70869]:     <acpi/>
Jul 25 15:58:21 user nova-compute[70869]:     <apic/>
Jul 25 15:58:21 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 15:58:21 user nova-compute[70869]:   </features>
Jul 25 15:58:21 user nova-compute[70869]:   <clock offset="utc">
Jul 25 15:58:21 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 15:58:21 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 15:58:21 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 15:58:21 user nova-compute[70869]:   </clock>
Jul 25 15:58:21 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 15:58:21 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 15:58:21 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 15:58:21 user nova-compute[70869]:   </cpu>
Jul 25 15:58:21 user nova-compute[70869]:   <devices>
Jul 25 15:58:21 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 15:58:21 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 15:58:21 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk"/>
Jul 25 15:58:21 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 15:58:21 user nova-compute[70869]:     </disk>
Jul 25 15:58:21 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 15:58:21 user nova-compute[70869]:       <mac address="fa:16:3e:3b:a6:2a"/>
Jul 25 15:58:21 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:58:21 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 15:58:21 user nova-compute[70869]:       <target dev="taped92dc75-b5"/>
Jul 25 15:58:21 user nova-compute[70869]:     </interface>
Jul 25 15:58:21 user nova-compute[70869]:     <serial type="pty">
Jul 25 15:58:21 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/console.log" append="off"/>
Jul 25 15:58:21 user nova-compute[70869]:     </serial>
Jul 25 15:58:21 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 15:58:21 user nova-compute[70869]:     <video>
Jul 25 15:58:21 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 15:58:21 user nova-compute[70869]:     </video>
Jul 25 15:58:21 user nova-compute[70869]:     <rng model="virtio">
Jul 25 15:58:21 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 15:58:21 user nova-compute[70869]:     </rng>
Jul 25 15:58:21 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 15:58:21 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 15:58:21 user nova-compute[70869]:       <stats period="10"/>
Jul 25 15:58:21 user nova-compute[70869]:     </memballoon>
Jul 25 15:58:21 user nova-compute[70869]:   </devices>
Jul 25 15:58:21 user nova-compute[70869]: </domain>
Jul 25 15:58:21 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1402637286',display_name='tempest-AttachVolumeNegativeTest-server-1402637286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1402637286',id=45,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORR+OxhJ8NHl9CItMMjkv4fLTWxFj3JYC9taxNsxbTpqPxUcG0CdgAov6tMb5yDDp7fEX7ESeWuLaNRKa6eeRIu3uB2wWoHanOesE+mKma7RJnROwzx20teyQLDI1XWkQ==',key_name='tempest-keypair-1693537147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-ea1n8mhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:58:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=bec5046f-9ed2-4813-8ab2-b2a61d37b2e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=ed92dc75-b5d9-4bd5-8838-6205adf9349e,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped92dc75-b5') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG os_vif [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=ed92dc75-b5d9-4bd5-8838-6205adf9349e,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped92dc75-b5') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped92dc75-b5, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped92dc75-b5, col_values=(('external_ids', {'iface-id': 'ed92dc75-b5d9-4bd5-8838-6205adf9349e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:a6:2a', 'vm-uuid': 'bec5046f-9ed2-4813-8ab2-b2a61d37b2e5'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:21 user nova-compute[70869]: INFO os_vif [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=ed92dc75-b5d9-4bd5-8838-6205adf9349e,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped92dc75-b5')
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No VIF found with MAC fa:16:3e:3b:a6:2a, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-922c5c2c-4ef0-47c8-81cf-967f25982a7c req-42c030bd-79b8-4705-89e3-69f732e3553f service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Updated VIF entry in instance network info cache for port ed92dc75-b5d9-4bd5-8838-6205adf9349e. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG nova.network.neutron [req-922c5c2c-4ef0-47c8-81cf-967f25982a7c req-42c030bd-79b8-4705-89e3-69f732e3553f service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Updating instance_info_cache with network_info: [{"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:58:21 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-922c5c2c-4ef0-47c8-81cf-967f25982a7c req-42c030bd-79b8-4705-89e3-69f732e3553f service nova] Releasing lock "refresh_cache-bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:58:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-f258087e-fb36-4d3c-8e44-e4988ea34357 req-09a5a9e6-ea2b-4350-9d32-6222aa3ce695 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received event network-vif-plugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:58:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f258087e-fb36-4d3c-8e44-e4988ea34357 req-09a5a9e6-ea2b-4350-9d32-6222aa3ce695 service nova] Acquiring lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f258087e-fb36-4d3c-8e44-e4988ea34357 req-09a5a9e6-ea2b-4350-9d32-6222aa3ce695 service nova] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-f258087e-fb36-4d3c-8e44-e4988ea34357 req-09a5a9e6-ea2b-4350-9d32-6222aa3ce695 service nova] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-f258087e-fb36-4d3c-8e44-e4988ea34357 req-09a5a9e6-ea2b-4350-9d32-6222aa3ce695 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] No waiting events found dispatching network-vif-plugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:58:22 user nova-compute[70869]: WARNING nova.compute.manager [req-f258087e-fb36-4d3c-8e44-e4988ea34357 req-09a5a9e6-ea2b-4350-9d32-6222aa3ce695 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received unexpected event network-vif-plugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e for instance with vm_state building and task_state spawning.
Jul 25 15:58:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300704.8219068, bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:58:24 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] VM Resumed (Lifecycle Event)
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 15:58:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Instance spawned successfully.
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 15:58:24 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300704.823412, bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:58:24 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] VM Started (Lifecycle Event)
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:58:24 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 15:58:24 user nova-compute[70869]: INFO nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Took 5.44 seconds to spawn the instance on the hypervisor.
Jul 25 15:58:24 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:58:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-2462a389-73ac-4171-ba53-0ed82b92a4fe req-66f494b3-3a4e-4ff4-9cd3-79c7480562b8 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received event network-vif-plugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:58:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2462a389-73ac-4171-ba53-0ed82b92a4fe req-66f494b3-3a4e-4ff4-9cd3-79c7480562b8 service nova] Acquiring lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2462a389-73ac-4171-ba53-0ed82b92a4fe req-66f494b3-3a4e-4ff4-9cd3-79c7480562b8 service nova] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-2462a389-73ac-4171-ba53-0ed82b92a4fe req-66f494b3-3a4e-4ff4-9cd3-79c7480562b8 service nova] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-2462a389-73ac-4171-ba53-0ed82b92a4fe req-66f494b3-3a4e-4ff4-9cd3-79c7480562b8 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] No waiting events found dispatching network-vif-plugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:58:25 user nova-compute[70869]: WARNING nova.compute.manager [req-2462a389-73ac-4171-ba53-0ed82b92a4fe req-66f494b3-3a4e-4ff4-9cd3-79c7480562b8 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received unexpected event network-vif-plugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e for instance with vm_state building and task_state spawning.
Jul 25 15:58:25 user nova-compute[70869]: INFO nova.compute.manager [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Took 6.11 seconds to build instance.
Jul 25 15:58:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d16f0454-1c08-41f8-82ac-d425b87a29cd tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.206s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-61799d01-e048-4812-98b4-9bb69db5c740 req-6240b45b-142b-4ff9-9bec-321fb3712e55 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received event network-changed-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG nova.compute.manager [req-61799d01-e048-4812-98b4-9bb69db5c740 req-6240b45b-142b-4ff9-9bec-321fb3712e55 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Refreshing instance network info cache due to event network-changed-81b4303b-9d9b-4838-a470-f84b67f02900. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-61799d01-e048-4812-98b4-9bb69db5c740 req-6240b45b-142b-4ff9-9bec-321fb3712e55 service nova] Acquiring lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-61799d01-e048-4812-98b4-9bb69db5c740 req-6240b45b-142b-4ff9-9bec-321fb3712e55 service nova] Acquired lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG nova.network.neutron [req-61799d01-e048-4812-98b4-9bb69db5c740 req-6240b45b-142b-4ff9-9bec-321fb3712e55 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Refreshing network info cache for port 81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG nova.network.neutron [req-61799d01-e048-4812-98b4-9bb69db5c740 req-6240b45b-142b-4ff9-9bec-321fb3712e55 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Updated VIF entry in instance network info cache for port 81b4303b-9d9b-4838-a470-f84b67f02900. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG nova.network.neutron [req-61799d01-e048-4812-98b4-9bb69db5c740 req-6240b45b-142b-4ff9-9bec-321fb3712e55 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Updating instance_info_cache with network_info: [{"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-61799d01-e048-4812-98b4-9bb69db5c740 req-6240b45b-142b-4ff9-9bec-321fb3712e55 service nova] Releasing lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG nova.objects.instance [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'flavor' on Instance uuid 199a97cd-a3b3-4711-88dc-ab4239f996fc {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:58:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:31 user nova-compute[70869]: INFO nova.compute.manager [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Attaching volume b206acb2-aad7-4e9e-ac36-dae654b0c7d9 to /dev/vdb
Jul 25 15:58:31 user nova-compute[70869]: DEBUG os_brick.utils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba010abe-6513-4fde-abcf-8bc6771127c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c123dae2-89ec-4561-84da-cf666611e2a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[91986adc-a5d9-42a5-9954-4c3776f029ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af2b55-a716-4c6f-920a-1a16ebb5d6a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:58:31 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:58:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[43007ca0-d95d-4562-96af-a0497339c30d]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG os_brick.utils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Updating existing volume attachment record: 3b6c4794-334f-4b98-b0f0-d767a3a44fce {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:58:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyPHfWdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:58:37 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:58:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:58:37 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:58:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:58:37 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5af7024-d054-4379-b812-5d7939e88f02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:58:37 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7517c36-4222-41a3-9799-abfade4e8e09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9] added
Jul 25 15:58:37 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cdf14d-6121-4884-bec3-6fefd895b759]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[864e93fb-bd39-4515-aeb8-b12bc6013935]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lyPHfWdV {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lyPHfWdV" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e791165-74b8-4c81-8980-b75cd4443106]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lyPHfWdV'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[629692ac-ccbc-408a-a785-7c60e1a39a99]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d18dc61-002b-4d2a-8a4e-21644caca8af]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:58:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:58:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba5cecc-11e4-485a-a053-48db1e9d0136]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9, portal: 172.16.0.220,3260]
Jul 25 15:58:38 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9, portal: 172.16.0.220,3260] successful.
Jul 25 15:58:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdd5479-baa1-4ffe-a00c-26833bf9df1a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0650e679-6a41-4421-b7b5-190eb8426136]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 (non-flash)
Jul 25 15:58:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:58:38 user nova-compute[70869]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 (non-flash)
Jul 25 15:58:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7205453-95c7-4555-8db2-4d63d9ac9aa1]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:58:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyPHfWdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26461376633346261', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461376633346261', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'flavor' on Instance uuid 199a97cd-a3b3-4711-88dc-ab4239f996fc {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:58:39 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:58:39 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:58:39 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:58:39 user nova-compute[70869]:   <serial>b206acb2-aad7-4e9e-ac36-dae654b0c7d9</serial>
Jul 25 15:58:39 user nova-compute[70869]: </disk>
Jul 25 15:58:39 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] No VIF found with MAC fa:16:3e:48:dd:74, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:58:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-53bfb216-63ef-42dc-b102-c152b8cb469e tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.810s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:41 user nova-compute[70869]: INFO nova.compute.manager [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Detaching volume b206acb2-aad7-4e9e-ac36-dae654b0c7d9
Jul 25 15:58:41 user nova-compute[70869]: INFO nova.virt.block_device [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Attempting to driver detach volume b206acb2-aad7-4e9e-ac36-dae654b0c7d9 from mountpoint /dev/vdb
Jul 25 15:58:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Attempting to detach device vdb from instance 199a97cd-a3b3-4711-88dc-ab4239f996fc from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 15:58:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:58:41 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:58:41 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:58:41 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:58:41 user nova-compute[70869]:   <serial>b206acb2-aad7-4e9e-ac36-dae654b0c7d9</serial>
Jul 25 15:58:41 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:58:41 user nova-compute[70869]: </disk>
Jul 25 15:58:41 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:58:41 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Successfully detached device vdb from instance 199a97cd-a3b3-4711-88dc-ab4239f996fc from the persistent domain config.
Jul 25 15:58:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 199a97cd-a3b3-4711-88dc-ab4239f996fc from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 15:58:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 15:58:41 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:58:41 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:58:41 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:58:41 user nova-compute[70869]:   <serial>b206acb2-aad7-4e9e-ac36-dae654b0c7d9</serial>
Jul 25 15:58:41 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 15:58:41 user nova-compute[70869]: </disk>
Jul 25 15:58:41 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300722.3856957, 199a97cd-a3b3-4711-88dc-ab4239f996fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 199a97cd-a3b3-4711-88dc-ab4239f996fc {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 15:58:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Successfully detached device vdb from instance 199a97cd-a3b3-4711-88dc-ab4239f996fc from the live domain config.
Jul 25 15:58:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyPHfWdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:58:42 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc197d07-8d05-402c-a59c-41de2b59ba93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 15:58:42 user nova-compute[70869]: No targets found.
Jul 25 15:58:42 user nova-compute[70869]: iSNS:
Jul 25 15:58:42 user nova-compute[70869]: No targets found.
Jul 25 15:58:42 user nova-compute[70869]: STATIC:
Jul 25 15:58:42 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e
Jul 25 15:58:42 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:58:42 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:58:42 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e
Jul 25 15:58:42 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:58:42 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:58:42 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9
Jul 25 15:58:42 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:58:42 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:58:42 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2
Jul 25 15:58:42 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 15:58:42 user nova-compute[70869]:                 Iface Name: default
Jul 25 15:58:42 user nova-compute[70869]: FIRMWARE:
Jul 25 15:58:42 user nova-compute[70869]: No targets found.
Jul 25 15:58:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 15:58:42 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 15:58:42 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec1a749-7922-4052-8444-c8880ac91219]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d63d98-c004-47ec-877d-076a5b6e627d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:42 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:42 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:58:42 user nova-compute[70869]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 (non-flash)
Jul 25 15:58:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:58:42 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:58:42 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:58:42 user nova-compute[70869]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 (non-flash)
Jul 25 15:58:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4341fa7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e097d41f-6626-4175-95b2-3fcc8bb0f1b1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[266aa3e3-f7cd-40dd-8d8e-20abc7c44c35]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ffc99-b3c3-49eb-bc86-8fe28cc5a265]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26c9bb9-8a49-41b9-98e6-e9835e86e54f]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6b9d7e-309e-4185-8ab9-378c07e28fe9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f08395-59b5-4f01-a0c1-f9df18a7fcf1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9, portal: 172.16.0.220,3260]
Jul 25 15:58:42 user nova-compute[70869]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9, portal: 172.16.0.220,3260] successful.
Jul 25 15:58:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b206acb2-aad7-4e9e-ac36-dae654b0c7d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2fdb84-8da9-43fc-8e74-efbacf58bb28]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] <== disconnect_volume: return (321ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:58:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.objects.instance [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'flavor' on Instance uuid 199a97cd-a3b3-4711-88dc-ab4239f996fc {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-85b47570-eee5-46a9-8986-c738d3b71e33 tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.845s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_power_states {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 263aedd4-9dbd-4232-986a-e250505153e5 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 835a1495-de8c-4649-a4ef-266be7914aa6 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 199a97cd-a3b3-4711-88dc-ab4239f996fc {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 45fb4262-b025-4455-b3ac-4c1909c4d1ef {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "263aedd4-9dbd-4232-986a-e250505153e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "263aedd4-9dbd-4232-986a-e250505153e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:58:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:58:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:58:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:58:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7641MB free_disk=25.115554809570312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:58:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 263aedd4-9dbd-4232-986a-e250505153e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d1ecb257-072c-4d1c-b2c4-15486ae66936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 835a1495-de8c-4649-a4ef-266be7914aa6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 199a97cd-a3b3-4711-88dc-ab4239f996fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 45fb4262-b025-4455-b3ac-4c1909c4d1ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:58:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:58:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:58:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 15:58:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:58:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:58:52 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:58:52 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:58:53 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updating instance_info_cache with network_info: [{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:58:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:58:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:58:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:58:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:58:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:58:56 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:59:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:59:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:59:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:59:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:59:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:59:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:59:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:59:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:59:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 15:59:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:59:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 15:59:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:31 user nova-compute[70869]: INFO nova.compute.manager [None req-85aa0cdb-49ae-4ff6-af8a-bbaa166584e1 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Unrescuing
Jul 25 15:59:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-85aa0cdb-49ae-4ff6-af8a-bbaa166584e1 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:59:31 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-85aa0cdb-49ae-4ff6-af8a-bbaa166584e1 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquired lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:59:31 user nova-compute[70869]: DEBUG nova.network.neutron [None req-85aa0cdb-49ae-4ff6-af8a-bbaa166584e1 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG nova.network.neutron [None req-85aa0cdb-49ae-4ff6-af8a-bbaa166584e1 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating instance_info_cache with network_info: [{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-85aa0cdb-49ae-4ff6-af8a-bbaa166584e1 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Releasing lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG nova.objects.instance [None req-85aa0cdb-49ae-4ff6-af8a-bbaa166584e1 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'flavor' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-9feb6e77-0674-4a64-8cb1-da1385988a7a req-1906f8e7-5187-44ec-8c37-8d9386734d8c service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-unplugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9feb6e77-0674-4a64-8cb1-da1385988a7a req-1906f8e7-5187-44ec-8c37-8d9386734d8c service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9feb6e77-0674-4a64-8cb1-da1385988a7a req-1906f8e7-5187-44ec-8c37-8d9386734d8c service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9feb6e77-0674-4a64-8cb1-da1385988a7a req-1906f8e7-5187-44ec-8c37-8d9386734d8c service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-9feb6e77-0674-4a64-8cb1-da1385988a7a req-1906f8e7-5187-44ec-8c37-8d9386734d8c service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-unplugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:59:32 user nova-compute[70869]: WARNING nova.compute.manager [req-9feb6e77-0674-4a64-8cb1-da1385988a7a req-1906f8e7-5187-44ec-8c37-8d9386734d8c service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-unplugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:59:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-22887682-7c06-461c-a550-edb3c6dcc06a req-9dd6f3d9-7605-4939-81bd-fdcd8c58e54f service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received event network-changed-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-22887682-7c06-461c-a550-edb3c6dcc06a req-9dd6f3d9-7605-4939-81bd-fdcd8c58e54f service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Refreshing instance network info cache due to event network-changed-81b4303b-9d9b-4838-a470-f84b67f02900. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-22887682-7c06-461c-a550-edb3c6dcc06a req-9dd6f3d9-7605-4939-81bd-fdcd8c58e54f service nova] Acquiring lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-22887682-7c06-461c-a550-edb3c6dcc06a req-9dd6f3d9-7605-4939-81bd-fdcd8c58e54f service nova] Acquired lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-22887682-7c06-461c-a550-edb3c6dcc06a req-9dd6f3d9-7605-4939-81bd-fdcd8c58e54f service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Refreshing network info cache for port 81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:33 user nova-compute[70869]: INFO nova.compute.manager [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Terminating instance
Jul 25 15:59:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 15:59:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Instance destroyed successfully.
Jul 25 15:59:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-dd585b53-d0fc-465d-8b71-c4121a21558b req-2e1ccedf-4756-473a-a4e2-476711762dee service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received event network-vif-unplugged-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dd585b53-d0fc-465d-8b71-c4121a21558b req-2e1ccedf-4756-473a-a4e2-476711762dee service nova] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dd585b53-d0fc-465d-8b71-c4121a21558b req-2e1ccedf-4756-473a-a4e2-476711762dee service nova] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-dd585b53-d0fc-465d-8b71-c4121a21558b req-2e1ccedf-4756-473a-a4e2-476711762dee service nova] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-dd585b53-d0fc-465d-8b71-c4121a21558b req-2e1ccedf-4756-473a-a4e2-476711762dee service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] No waiting events found dispatching network-vif-unplugged-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-dd585b53-d0fc-465d-8b71-c4121a21558b req-2e1ccedf-4756-473a-a4e2-476711762dee service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received event network-vif-unplugged-81b4303b-9d9b-4838-a470-f84b67f02900 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-22887682-7c06-461c-a550-edb3c6dcc06a req-9dd6f3d9-7605-4939-81bd-fdcd8c58e54f service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Updated VIF entry in instance network info cache for port 81b4303b-9d9b-4838-a470-f84b67f02900. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-22887682-7c06-461c-a550-edb3c6dcc06a req-9dd6f3d9-7605-4939-81bd-fdcd8c58e54f service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Updating instance_info_cache with network_info: [{"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:59:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-22887682-7c06-461c-a550-edb3c6dcc06a req-9dd6f3d9-7605-4939-81bd-fdcd8c58e54f service nova] Releasing lock "refresh_cache-199a97cd-a3b3-4711-88dc-ab4239f996fc" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:59:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Instance destroyed successfully.
Jul 25 15:59:34 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'resources' on Instance uuid 199a97cd-a3b3-4711-88dc-ab4239f996fc {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1948827363',display_name='tempest-TestStampPattern-server-1948827363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1948827363',id=42,image_ref='63f8cb07-feeb-4468-bd4e-57ecb88fd5b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElU+k0rYhronu9BRexD90+MpLjOziUBLG+MBblKgeyeqhBtK3ZZxmOSTMgIcyGCVGFadf5Axe2ypZfEAo6F7i3fDoJINEYS2h5LlPs+FC+P6iRvLoE5Lhlii2I+TRFzJg==',key_name='tempest-TestStampPattern-1826637939',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43515216642447938c73f1a2536d095b',ramdisk_id='',reservation_id='r-q5kpj8ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='263aedd4-9dbd-4232-986a-e250505153e5',image_min_disk='1',image_min_ram='0',image_owner_id='43515216642447938c73f1a2536d095b',image_owner_project_name='tempest-TestStampPattern-1006666307',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1006666307-project-member',image_user_id='e9fac4d2818f46dc82613cf63b921a1b',owner_project_name='tempest-TestStampPattern-1006666307',owner_user_name='tempest-TestStampPattern-1006666307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:56:45Z,user_data=None,user_id='e9fac4d2818f46dc82613cf63b921a1b',uuid=199a97cd-a3b3-4711-88dc-ab4239f996fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converting VIF {"id": "81b4303b-9d9b-4838-a470-f84b67f02900", "address": "fa:16:3e:48:dd:74", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4303b-9d", "ovs_interfaceid": "81b4303b-9d9b-4838-a470-f84b67f02900", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=81b4303b-9d9b-4838-a470-f84b67f02900,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4303b-9d') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG os_vif [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=81b4303b-9d9b-4838-a470-f84b67f02900,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4303b-9d') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81b4303b-9d, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:34 user nova-compute[70869]: INFO os_vif [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=81b4303b-9d9b-4838-a470-f84b67f02900,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4303b-9d')
Jul 25 15:59:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Deleting instance files /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc_del
Jul 25 15:59:34 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Deletion of /opt/stack/data/nova/instances/199a97cd-a3b3-4711-88dc-ab4239f996fc_del complete
Jul 25 15:59:34 user nova-compute[70869]: INFO nova.compute.manager [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Took 1.38 seconds to destroy the instance on the hypervisor.
Jul 25 15:59:34 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-36c38557-ff64-4418-af86-4c6e425d0199 req-23a1908b-d97e-4569-be83-f032f511483d service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-36c38557-ff64-4418-af86-4c6e425d0199 req-23a1908b-d97e-4569-be83-f032f511483d service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-36c38557-ff64-4418-af86-4c6e425d0199 req-23a1908b-d97e-4569-be83-f032f511483d service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-36c38557-ff64-4418-af86-4c6e425d0199 req-23a1908b-d97e-4569-be83-f032f511483d service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-36c38557-ff64-4418-af86-4c6e425d0199 req-23a1908b-d97e-4569-be83-f032f511483d service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:59:35 user nova-compute[70869]: WARNING nova.compute.manager [req-36c38557-ff64-4418-af86-4c6e425d0199 req-23a1908b-d97e-4569-be83-f032f511483d service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state rescued and task_state unrescuing.
Jul 25 15:59:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-98fddb6c-1cd7-4845-bfa1-566b49356398 req-685883c9-95a7-4937-90e6-ce61831761f8 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received event network-vif-plugged-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-98fddb6c-1cd7-4845-bfa1-566b49356398 req-685883c9-95a7-4937-90e6-ce61831761f8 service nova] Acquiring lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-98fddb6c-1cd7-4845-bfa1-566b49356398 req-685883c9-95a7-4937-90e6-ce61831761f8 service nova] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-98fddb6c-1cd7-4845-bfa1-566b49356398 req-685883c9-95a7-4937-90e6-ce61831761f8 service nova] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-98fddb6c-1cd7-4845-bfa1-566b49356398 req-685883c9-95a7-4937-90e6-ce61831761f8 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] No waiting events found dispatching network-vif-plugged-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:59:35 user nova-compute[70869]: WARNING nova.compute.manager [req-98fddb6c-1cd7-4845-bfa1-566b49356398 req-685883c9-95a7-4937-90e6-ce61831761f8 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received unexpected event network-vif-plugged-81b4303b-9d9b-4838-a470-f84b67f02900 for instance with vm_state active and task_state deleting.
Jul 25 15:59:35 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:59:35 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Took 1.26 seconds to deallocate network for instance.
Jul 25 15:59:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:36 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:59:36 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:59:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:36 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Deleted allocations for instance 199a97cd-a3b3-4711-88dc-ab4239f996fc
Jul 25 15:59:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a51b7cad-6603-43a0-bd11-24bc4bd4fdac tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "199a97cd-a3b3-4711-88dc-ab4239f996fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.132s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:36 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Removed pending event for d1ecb257-072c-4d1c-b2c4-15486ae66936 due to event {{(pid=70869) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 25 15:59:36 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300776.989503, d1ecb257-072c-4d1c-b2c4-15486ae66936 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:59:36 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] VM Resumed (Lifecycle Event)
Jul 25 15:59:36 user nova-compute[70869]: DEBUG nova.compute.manager [None req-85aa0cdb-49ae-4ff6-af8a-bbaa166584e1 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:59:37 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300776.9912608, d1ecb257-072c-4d1c-b2c4-15486ae66936 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:59:37 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] VM Started (Lifecycle Event)
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:59:37 user nova-compute[70869]: WARNING nova.compute.manager [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state active and task_state None.
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 15:59:37 user nova-compute[70869]: WARNING nova.compute.manager [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state active and task_state None.
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-fe04e5cf-b588-4552-b8c5-70c0b44e174f req-4380479a-81b7-4725-80f1-185cc1fba573 service nova] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Received event network-vif-deleted-81b4303b-9d9b-4838-a470-f84b67f02900 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-6c0fc643-2755-4fa6-8c5d-fcd6170fb6bb req-db16a6e4-7662-42fb-97b8-f4a00bbaf662 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-changed-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.compute.manager [req-6c0fc643-2755-4fa6-8c5d-fcd6170fb6bb req-db16a6e4-7662-42fb-97b8-f4a00bbaf662 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Refreshing instance network info cache due to event network-changed-ea89090c-ff7a-4492-81bd-0d948d382c03. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6c0fc643-2755-4fa6-8c5d-fcd6170fb6bb req-db16a6e4-7662-42fb-97b8-f4a00bbaf662 service nova] Acquiring lock "refresh_cache-45fb4262-b025-4455-b3ac-4c1909c4d1ef" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6c0fc643-2755-4fa6-8c5d-fcd6170fb6bb req-db16a6e4-7662-42fb-97b8-f4a00bbaf662 service nova] Acquired lock "refresh_cache-45fb4262-b025-4455-b3ac-4c1909c4d1ef" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-6c0fc643-2755-4fa6-8c5d-fcd6170fb6bb req-db16a6e4-7662-42fb-97b8-f4a00bbaf662 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Refreshing network info cache for port ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'flavor' on Instance uuid 45fb4262-b025-4455-b3ac-4c1909c4d1ef {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:59:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Ignoring supplied device name: /dev/vdb
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:37 user nova-compute[70869]: INFO nova.compute.manager [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Attaching volume cd54a2ac-7ef3-4964-900e-7867fd65f436 to /dev/vdb
Jul 25 15:59:37 user nova-compute[70869]: DEBUG os_brick.utils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-6c0fc643-2755-4fa6-8c5d-fcd6170fb6bb req-db16a6e4-7662-42fb-97b8-f4a00bbaf662 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Updated VIF entry in instance network info cache for port ea89090c-ff7a-4492-81bd-0d948d382c03. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.network.neutron [req-6c0fc643-2755-4fa6-8c5d-fcd6170fb6bb req-db16a6e4-7662-42fb-97b8-f4a00bbaf662 service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Updating instance_info_cache with network_info: [{"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[651e24c7-7065-4e79-a742-59e43b373176]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6c0fc643-2755-4fa6-8c5d-fcd6170fb6bb req-db16a6e4-7662-42fb-97b8-f4a00bbaf662 service nova] Releasing lock "refresh_cache-45fb4262-b025-4455-b3ac-4c1909c4d1ef" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b81ad2-9df6-4603-aea8-c883f6c9e66f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[da09c0a8-79d0-4f13-bdf6-35d7229ed267]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[976672a4-ba41-49ba-b845-9328b7727145]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 15:59:37 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 15:59:37 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[175f9f34-53fd-4c8d-b872-6037d40a05ae]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG os_brick.utils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:59:37 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Updating existing volume attachment record: d784416b-22aa-4ead-a50c-c7acb9e1b80f {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 15:59:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 15:59:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjhaMKLX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 15:59:44 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:59:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:59:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:59:44 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 15:59:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 15:59:44 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 15:59:44 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 15:59:44 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d09aeb-68f0-49b0-83f3-674c9e4eac70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 15:59:45 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9023bb8-d48b-4256-be73-cd4698166b60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436] added
Jul 25 15:59:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e5d2c8-a3a7-4609-9a14-713c0babd0b1]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4ac755-43fc-4682-aaff-7ec1fbdbfde7]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjhaMKLX {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjhaMKLX" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[210491f9-f034-4011-bf9d-0efe227638e0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SjhaMKLX'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20f91e-4be1-4d5a-805a-0ed6b68d18b0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eeb273-22ad-462f-938c-d17d128c4d4f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:59:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:59:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf8611b-f0ca-4faf-ba62-05594341ec57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436, portal: 172.16.0.220,3260]
Jul 25 15:59:45 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436, portal: 172.16.0.220,3260] successful.
Jul 25 15:59:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25ea44d-1fe4-4b03-b024-866efd6216c4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1290d865-39e1-46fc-bd5b-4ac2d830adfc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 (non-flash)
Jul 25 15:59:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 15:59:45 user nova-compute[70869]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 (non-flash)
Jul 25 15:59:45 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e263e4-b802-4201-882f-42c346e98e8a]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 15:59:45 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjhaMKLX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23236366661623737', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236366661623737', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'flavor' on Instance uuid 45fb4262-b025-4455-b3ac-4c1909c4d1ef {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 15:59:46 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 15:59:46 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 15:59:46 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 15:59:46 user nova-compute[70869]:   <serial>cd54a2ac-7ef3-4964-900e-7867fd65f436</serial>
Jul 25 15:59:46 user nova-compute[70869]: </disk>
Jul 25 15:59:46 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] No VIF found with MAC fa:16:3e:67:4f:84, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5ecc763c-4543-4c7c-9023-d545bef3c525 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.129s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-ecfde4ff-02ed-40bd-b6ab-0aa75e91ecd7 req-91de1ccd-13d3-48c1-b0f8-557a8272ebd6 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received event network-changed-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-ecfde4ff-02ed-40bd-b6ab-0aa75e91ecd7 req-91de1ccd-13d3-48c1-b0f8-557a8272ebd6 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Refreshing instance network info cache due to event network-changed-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ecfde4ff-02ed-40bd-b6ab-0aa75e91ecd7 req-91de1ccd-13d3-48c1-b0f8-557a8272ebd6 service nova] Acquiring lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ecfde4ff-02ed-40bd-b6ab-0aa75e91ecd7 req-91de1ccd-13d3-48c1-b0f8-557a8272ebd6 service nova] Acquired lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.network.neutron [req-ecfde4ff-02ed-40bd-b6ab-0aa75e91ecd7 req-91de1ccd-13d3-48c1-b0f8-557a8272ebd6 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Refreshing network info cache for port ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300774.514673, 199a97cd-a3b3-4711-88dc-ab4239f996fc => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 15:59:49 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] VM Stopped (Lifecycle Event)
Jul 25 15:59:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:59:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=7911MB free_disk=25.113815307617188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f78f0bb4-7e52-46b9-bc11-73e21bb2f856 None None] [instance: 199a97cd-a3b3-4711-88dc-ab4239f996fc] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 263aedd4-9dbd-4232-986a-e250505153e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d1ecb257-072c-4d1c-b2c4-15486ae66936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 835a1495-de8c-4649-a4ef-266be7914aa6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 45fb4262-b025-4455-b3ac-4c1909c4d1ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 15:59:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 15:59:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-ecfde4ff-02ed-40bd-b6ab-0aa75e91ecd7 req-91de1ccd-13d3-48c1-b0f8-557a8272ebd6 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Updated VIF entry in instance network info cache for port ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 15:59:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-ecfde4ff-02ed-40bd-b6ab-0aa75e91ecd7 req-91de1ccd-13d3-48c1-b0f8-557a8272ebd6 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Updating instance_info_cache with network_info: [{"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:59:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-ecfde4ff-02ed-40bd-b6ab-0aa75e91ecd7 req-91de1ccd-13d3-48c1-b0f8-557a8272ebd6 service nova] Releasing lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:59:50 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:59:50 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:59:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 15:59:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updating instance_info_cache with network_info: [{"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-a140f33e-19d2-41fa-9fbe-4b2791e2888c" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 15:59:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:56 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:56 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "bf860245-f481-4f4d-a478-ebde47c5d796" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "bf860245-f481-4f4d-a478-ebde47c5d796" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 15:59:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 15:59:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 15:59:57 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 15:59:57 user nova-compute[70869]: INFO nova.compute.claims [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Claim successful on node user
Jul 25 15:59:58 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 15:59:58 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 15:59:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 15:59:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 15:59:58 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 15:59:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 15:59:58 user nova-compute[70869]: DEBUG nova.network.neutron [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 15:59:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 15:59:58 user nova-compute[70869]: INFO nova.virt.block_device [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Booting with volume snapshot 5f958880-5dc2-4af7-bebc-7ef9d0c818a6 at /dev/vda
Jul 25 15:59:58 user nova-compute[70869]: DEBUG nova.policy [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f175a95c6c4e43b4b7d1910419070bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d4fe99fc224a2686f2f3daf32ecbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 15:59:58 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG nova.network.neutron [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Successfully created port: 3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG nova.network.neutron [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Successfully updated port: 3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "refresh_cache-bf860245-f481-4f4d-a478-ebde47c5d796" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquired lock "refresh_cache-bf860245-f481-4f4d-a478-ebde47c5d796" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG nova.network.neutron [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-65ba0d7b-5665-4687-8ac8-be6cc29e91e3 req-f95d44cc-5bcd-46e8-b2e7-0ea9685b7ee7 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received event network-changed-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-65ba0d7b-5665-4687-8ac8-be6cc29e91e3 req-f95d44cc-5bcd-46e8-b2e7-0ea9685b7ee7 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Refreshing instance network info cache due to event network-changed-3b8d729d-cca3-4f09-b96b-2219cd813371. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 15:59:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-65ba0d7b-5665-4687-8ac8-be6cc29e91e3 req-f95d44cc-5bcd-46e8-b2e7-0ea9685b7ee7 service nova] Acquiring lock "refresh_cache-bf860245-f481-4f4d-a478-ebde47c5d796" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:00:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:00:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Updating instance_info_cache with network_info: [{"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Releasing lock "refresh_cache-bf860245-f481-4f4d-a478-ebde47c5d796" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:00:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Instance network_info: |[{"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:00:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-65ba0d7b-5665-4687-8ac8-be6cc29e91e3 req-f95d44cc-5bcd-46e8-b2e7-0ea9685b7ee7 service nova] Acquired lock "refresh_cache-bf860245-f481-4f4d-a478-ebde47c5d796" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:00:00 user nova-compute[70869]: DEBUG nova.network.neutron [req-65ba0d7b-5665-4687-8ac8-be6cc29e91e3 req-f95d44cc-5bcd-46e8-b2e7-0ea9685b7ee7 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Refreshing network info cache for port 3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:00:01 user nova-compute[70869]: DEBUG nova.network.neutron [req-65ba0d7b-5665-4687-8ac8-be6cc29e91e3 req-f95d44cc-5bcd-46e8-b2e7-0ea9685b7ee7 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Updated VIF entry in instance network info cache for port 3b8d729d-cca3-4f09-b96b-2219cd813371. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:00:01 user nova-compute[70869]: DEBUG nova.network.neutron [req-65ba0d7b-5665-4687-8ac8-be6cc29e91e3 req-f95d44cc-5bcd-46e8-b2e7-0ea9685b7ee7 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Updating instance_info_cache with network_info: [{"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-65ba0d7b-5665-4687-8ac8-be6cc29e91e3 req-f95d44cc-5bcd-46e8-b2e7-0ea9685b7ee7 service nova] Releasing lock "refresh_cache-bf860245-f481-4f4d-a478-ebde47c5d796" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG os_brick.utils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[969526bb-ce96-4259-b002-a0ef88af3a50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5575f9f2-442d-480c-a9ca-99f1e74f1e4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bf1ff1-19c3-4162-98a1-f75001946e68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3638cf-347e-4ccc-a7d4-cab87d50cac3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:03 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:00:04 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:00:04 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eb7b6c-6b19-4fa8-9269-8c63ad77ccf8]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG os_brick.utils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Updating existing volume attachment record: 9ca59b25-7a1d-44f0-bb10-a7f2ffd0e40f {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:00:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:09 user nova-compute[70869]: INFO nova.compute.manager [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Detaching volume cd54a2ac-7ef3-4964-900e-7867fd65f436
Jul 25 16:00:09 user nova-compute[70869]: INFO nova.virt.block_device [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Attempting to driver detach volume cd54a2ac-7ef3-4964-900e-7867fd65f436 from mountpoint /dev/vdb
Jul 25 16:00:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Attempting to detach device vdb from instance 45fb4262-b025-4455-b3ac-4c1909c4d1ef from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:00:09 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:00:09 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 16:00:09 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:00:09 user nova-compute[70869]:   <serial>cd54a2ac-7ef3-4964-900e-7867fd65f436</serial>
Jul 25 16:00:09 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:00:09 user nova-compute[70869]: </disk>
Jul 25 16:00:09 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:00:09 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Successfully detached device vdb from instance 45fb4262-b025-4455-b3ac-4c1909c4d1ef from the persistent domain config.
Jul 25 16:00:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45fb4262-b025-4455-b3ac-4c1909c4d1ef from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:00:09 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:00:09 user nova-compute[70869]:   <source dev="/dev/sde"/>
Jul 25 16:00:09 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:00:09 user nova-compute[70869]:   <serial>cd54a2ac-7ef3-4964-900e-7867fd65f436</serial>
Jul 25 16:00:09 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:00:09 user nova-compute[70869]: </disk>
Jul 25 16:00:09 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300809.7311893, 45fb4262-b025-4455-b3ac-4c1909c4d1ef => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45fb4262-b025-4455-b3ac-4c1909c4d1ef {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:00:09 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Successfully detached device vdb from instance 45fb4262-b025-4455-b3ac-4c1909c4d1ef from the live domain config.
Jul 25 16:00:09 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjhaMKLX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:00:09 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae385a-4ddc-4714-806a-48377a06af35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:00:09 user nova-compute[70869]: No targets found.
Jul 25 16:00:09 user nova-compute[70869]: iSNS:
Jul 25 16:00:09 user nova-compute[70869]: No targets found.
Jul 25 16:00:09 user nova-compute[70869]: STATIC:
Jul 25 16:00:09 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e
Jul 25 16:00:09 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:00:09 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:00:09 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e
Jul 25 16:00:09 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:00:09 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:00:09 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2
Jul 25 16:00:09 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:00:09 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:00:09 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436
Jul 25 16:00:09 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:00:09 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:00:09 user nova-compute[70869]: FIRMWARE:
Jul 25 16:00:09 user nova-compute[70869]: No targets found.
Jul 25 16:00:09 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:00:09 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:00:09 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905226e-d837-4b56-8015-de66a16dbc09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d1f9c5-5531-411c-9725-0c215c12cfde]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:00:09 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:00:09 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:00:09 user nova-compute[70869]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 (non-flash)
Jul 25 16:00:09 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:00:09 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:00:09 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:00:09 user nova-compute[70869]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 (non-flash)
Jul 25 16:00:09 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4343c4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[104c2666-92e8-40fe-90c1-6843bfd8d4f8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4887524c-4590-4e44-9b0f-95eee729adf5]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1307a919-4463-47bc-9744-3e9f8ead9c02]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[242c2c95-6e92-405c-940b-5761cedba2d7]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[045a026a-0433-4245-8139-9e7b15f6428b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:09 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[feee4972-18e8-4dc9-a8bf-49af28781547]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436, portal: 172.16.0.220,3260]
Jul 25 16:00:10 user nova-compute[70869]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436, portal: 172.16.0.220,3260] successful.
Jul 25 16:00:10 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d317ab4-1e19-4423-acfa-cc63e3b05aad]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] <== disconnect_volume: return (344ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-880a9fde-2c36-4e55-8834-2e6b3fb7a81a req-6b12fd2a-fed1-4f7a-8b3c-6b119ef37677 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received event network-changed-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-880a9fde-2c36-4e55-8834-2e6b3fb7a81a req-6b12fd2a-fed1-4f7a-8b3c-6b119ef37677 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Refreshing instance network info cache due to event network-changed-ed92dc75-b5d9-4bd5-8838-6205adf9349e. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-880a9fde-2c36-4e55-8834-2e6b3fb7a81a req-6b12fd2a-fed1-4f7a-8b3c-6b119ef37677 service nova] Acquiring lock "refresh_cache-bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-880a9fde-2c36-4e55-8834-2e6b3fb7a81a req-6b12fd2a-fed1-4f7a-8b3c-6b119ef37677 service nova] Acquired lock "refresh_cache-bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-880a9fde-2c36-4e55-8834-2e6b3fb7a81a req-6b12fd2a-fed1-4f7a-8b3c-6b119ef37677 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Refreshing network info cache for port ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:10 user nova-compute[70869]: INFO nova.compute.manager [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Terminating instance
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.compute.manager [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-880a9fde-2c36-4e55-8834-2e6b3fb7a81a req-6b12fd2a-fed1-4f7a-8b3c-6b119ef37677 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Updated VIF entry in instance network info cache for port ed92dc75-b5d9-4bd5-8838-6205adf9349e. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.network.neutron [req-880a9fde-2c36-4e55-8834-2e6b3fb7a81a req-6b12fd2a-fed1-4f7a-8b3c-6b119ef37677 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Updating instance_info_cache with network_info: [{"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-880a9fde-2c36-4e55-8834-2e6b3fb7a81a req-6b12fd2a-fed1-4f7a-8b3c-6b119ef37677 service nova] Releasing lock "refresh_cache-bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-923316aa-5a0b-4749-b7d9-269ba4bfba38 req-f3c05c4a-879f-4315-8fcb-5aa669fc5397 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received event network-vif-unplugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-923316aa-5a0b-4749-b7d9-269ba4bfba38 req-f3c05c4a-879f-4315-8fcb-5aa669fc5397 service nova] Acquiring lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-923316aa-5a0b-4749-b7d9-269ba4bfba38 req-f3c05c4a-879f-4315-8fcb-5aa669fc5397 service nova] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-923316aa-5a0b-4749-b7d9-269ba4bfba38 req-f3c05c4a-879f-4315-8fcb-5aa669fc5397 service nova] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-923316aa-5a0b-4749-b7d9-269ba4bfba38 req-f3c05c4a-879f-4315-8fcb-5aa669fc5397 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] No waiting events found dispatching network-vif-unplugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.compute.manager [req-923316aa-5a0b-4749-b7d9-269ba4bfba38 req-f3c05c4a-879f-4315-8fcb-5aa669fc5397 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received event network-vif-unplugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:10 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'flavor' on Instance uuid 45fb4262-b025-4455-b3ac-4c1909c4d1ef {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3f3163d2-9cfe-4663-927d-28479e8b4433 tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.836s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.693s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:11 user nova-compute[70869]: INFO nova.compute.manager [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Terminating instance
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Instance destroyed successfully.
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.objects.instance [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'resources' on Instance uuid bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1402637286',display_name='tempest-AttachVolumeNegativeTest-server-1402637286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1402637286',id=45,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORR+OxhJ8NHl9CItMMjkv4fLTWxFj3JYC9taxNsxbTpqPxUcG0CdgAov6tMb5yDDp7fEX7ESeWuLaNRKa6eeRIu3uB2wWoHanOesE+mKma7RJnROwzx20teyQLDI1XWkQ==',key_name='tempest-keypair-1693537147',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-ea1n8mhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=bec5046f-9ed2-4813-8ab2-b2a61d37b2e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "address": "fa:16:3e:3b:a6:2a", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped92dc75-b5", "ovs_interfaceid": "ed92dc75-b5d9-4bd5-8838-6205adf9349e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=ed92dc75-b5d9-4bd5-8838-6205adf9349e,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped92dc75-b5') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_vif [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=ed92dc75-b5d9-4bd5-8838-6205adf9349e,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped92dc75-b5') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:00:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Creating image(s)
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Ensure instance console log exists: /opt/stack/data/nova/instances/bf860245-f481-4f4d-a478-ebde47c5d796/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Start _get_guest_xml network_info=[{"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-25T15:59:51Z,direct_url=<?>,disk_format='qcow2',id=4114a8d0-7213-4a1b-9537-08fa4aca9d21,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-622893080',owner='a0d4fe99fc224a2686f2f3daf32ecbd5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-25T15:59:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9ca59b25-7a1d-44f0-bb10-a7f2ffd0e40f', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUetgqGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf860245-f481-4f4d-a478-ebde47c5d796', 'attached_at': '', 'detached_at': '', 'volume_id': '75d94404-4427-4600-b288-ad583bab1c5e', 'serial': '75d94404-4427-4600-b288-ad583bab1c5e'}, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped92dc75-b5, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:00:11 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:00:11 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-25T15:59:51Z,direct_url=<?>,disk_format='qcow2',id=4114a8d0-7213-4a1b-9537-08fa4aca9d21,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-622893080',owner='a0d4fe99fc224a2686f2f3daf32ecbd5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-25T15:59:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUetgqGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:00:11 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:00:11 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:00:11 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:00:11 user nova-compute[70869]: INFO os_vif [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=ed92dc75-b5d9-4bd5-8838-6205adf9349e,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped92dc75-b5')
Jul 25 16:00:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Deleting instance files /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5_del
Jul 25 16:00:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Deletion of /opt/stack/data/nova/instances/bec5046f-9ed2-4813-8ab2-b2a61d37b2e5_del complete
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5f0d02-98a4-4032-8924-005c4b548173]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:00:11 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fea45c-4908-4692-b560-a4c86a85a7bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e] added
Jul 25 16:00:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[96817cde-f984-4274-91bd-a790fdfa5c61]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: INFO nova.compute.manager [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a846c8-ce6e-494a-9834-227a30213a81]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUetgqGv {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUetgqGv" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f118cb8-12ff-46bd-b7a9-1ee54b27b34c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yUetgqGv'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ac236a-7912-4430-ab24-7c80444f87ec]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb6dc9b-a391-45a0-bdbb-9711a2965e39]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:00:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:00:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5c21f2-c498-43a8-9baf-1ccea806a267]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e, portal: 172.16.0.220,3260]
Jul 25 16:00:11 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e, portal: 172.16.0.220,3260] successful.
Jul 25 16:00:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9806fcbb-5a1a-440f-9b03-9909d3c7bac5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d782cb7c-c250-4f66-b21d-6fd973d0bf77]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:00:11 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:00:11 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] HCTL ('36', '-', '-', 0) found on session 55 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c2e0c6-cd43-46c7-900e-6202321b70eb]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Instance destroyed successfully.
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lazy-loading 'resources' on Instance uuid 45fb4262-b025-4455-b3ac-4c1909c4d1ef {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1346132266',display_name='tempest-VolumesSnapshotTestJSON-instance-1346132266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1346132266',id=43,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLz4w+ft0EHX/46YL4uR9CV31lPEpe0Jvp9MHAFiJIASuXNZcmmjnzgUQ/vMX0LiXdm0oPK0h6jpjB8qYC2HlR97BRh9bwOuvbsxi+CLmyxzLKdnn4MoCn9IjpHBRWCRg==',key_name='tempest-keypair-798198216',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edcc8bf5793a4869bff694fb5bc8704f',ramdisk_id='',reservation_id='r-e5fizdl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-529637024',owner_user_name='tempest-VolumesSnapshotTestJSON-529637024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:57:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5652c0b752845cca61ba15971ef63fe',uuid=45fb4262-b025-4455-b3ac-4c1909c4d1ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converting VIF {"id": "ea89090c-ff7a-4492-81bd-0d948d382c03", "address": "fa:16:3e:67:4f:84", "network": {"id": "a38d9426-dcc2-40bf-ad21-f349e3af7697", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-924800242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edcc8bf5793a4869bff694fb5bc8704f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea89090c-ff", "ovs_interfaceid": "ea89090c-ff7a-4492-81bd-0d948d382c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:4f:84,bridge_name='br-int',has_traffic_filtering=True,id=ea89090c-ff7a-4492-81bd-0d948d382c03,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea89090c-ff') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_vif [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:4f:84,bridge_name='br-int',has_traffic_filtering=True,id=ea89090c-ff7a-4492-81bd-0d948d382c03,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea89090c-ff') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea89090c-ff, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:11 user nova-compute[70869]: INFO os_vif [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:4f:84,bridge_name='br-int',has_traffic_filtering=True,id=ea89090c-ff7a-4492-81bd-0d948d382c03,network=Network(a38d9426-dcc2-40bf-ad21-f349e3af7697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea89090c-ff')
Jul 25 16:00:11 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjhaMKLX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:00:11 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:00:11 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:12 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Took 0.98 seconds to deallocate network for instance.
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-c9a705bb-4dcc-48ba-97b7-eebdf928f236 req-8bfe0b9d-63ba-4550-afa2-94c4be9a3556 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received event network-vif-deleted-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:12 user nova-compute[70869]: INFO nova.compute.manager [req-c9a705bb-4dcc-48ba-97b7-eebdf928f236 req-8bfe0b9d-63ba-4550-afa2-94c4be9a3556 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Neutron deleted interface ed92dc75-b5d9-4bd5-8838-6205adf9349e; detaching it from the instance and deleting it from the info cache
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.network.neutron [req-c9a705bb-4dcc-48ba-97b7-eebdf928f236 req-8bfe0b9d-63ba-4550-afa2-94c4be9a3556 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-c9a705bb-4dcc-48ba-97b7-eebdf928f236 req-8bfe0b9d-63ba-4550-afa2-94c4be9a3556 service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Detach interface failed, port_id=ed92dc75-b5d9-4bd5-8838-6205adf9349e, reason: Instance bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUetgqGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23063613832346566', 'path': '/dev/sde'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063613832346566', 'path': '/dev/sde'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.782s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50847ad-aeec-42f1-9c1f-7f1810a3fb39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:00:12 user nova-compute[70869]: No targets found.
Jul 25 16:00:12 user nova-compute[70869]: iSNS:
Jul 25 16:00:12 user nova-compute[70869]: No targets found.
Jul 25 16:00:12 user nova-compute[70869]: STATIC:
Jul 25 16:00:12 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e
Jul 25 16:00:12 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:00:12 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:00:12 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e
Jul 25 16:00:12 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:00:12 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:00:12 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e
Jul 25 16:00:12 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:00:12 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:00:12 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2
Jul 25 16:00:12 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:00:12 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:00:12 user nova-compute[70869]: FIRMWARE:
Jul 25 16:00:12 user nova-compute[70869]: No targets found.
Jul 25 16:00:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:00:12 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:00:12 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd54a2ac-7ef3-4964-900e-7867fd65f436', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-40506904',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-40506904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-40506904',id=46,image_ref='4114a8d0-7213-4a1b-9537-08fa4aca9d21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGD2OEJSTgtYidRkWNvYnkHjF6SrNK2kM4erEC726LGKbhYVZLj7Z7EdyPP9KeOwwT/VcUlRL2BxvG30w2KXVaFKq42hhPyndrwzPHpuNlyejL8LymquL1RKgcvPohfVWg==',key_name='tempest-keypair-1458741157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-phyd3sse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1492727042',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:59:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=bf860245-f481-4f4d-a478-ebde47c5d796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:1a:96,bridge_name='br-int',has_traffic_filtering=True,id=3b8d729d-cca3-4f09-b96b-2219cd813371,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8d729d-cc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.objects.instance [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'pci_devices' on Instance uuid bf860245-f481-4f4d-a478-ebde47c5d796 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c081d25-0d51-4f6a-b750-1af161b705d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:00:12 user nova-compute[70869]:   <uuid>bf860245-f481-4f4d-a478-ebde47c5d796</uuid>
Jul 25 16:00:12 user nova-compute[70869]:   <name>instance-0000002e</name>
Jul 25 16:00:12 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 16:00:12 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 16:00:12 user nova-compute[70869]:   <metadata>
Jul 25 16:00:12 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:00:12 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 16:00:12 user nova-compute[70869]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-40506904</nova:name>
Jul 25 16:00:12 user nova-compute[70869]:       <nova:creationTime>2023-07-25 16:00:11</nova:creationTime>
Jul 25 16:00:12 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 16:00:12 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 16:00:12 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 16:00:12 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 16:00:12 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:00:12 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:00:12 user nova-compute[70869]:       </nova:flavor>
Jul 25 16:00:12 user nova-compute[70869]:       <nova:owner>
Jul 25 16:00:12 user nova-compute[70869]:         <nova:user uuid="f175a95c6c4e43b4b7d1910419070bf7">tempest-TestVolumeBootPattern-1492727042-project-member</nova:user>
Jul 25 16:00:12 user nova-compute[70869]:         <nova:project uuid="a0d4fe99fc224a2686f2f3daf32ecbd5">tempest-TestVolumeBootPattern-1492727042</nova:project>
Jul 25 16:00:12 user nova-compute[70869]:       </nova:owner>
Jul 25 16:00:12 user nova-compute[70869]:       <nova:root type="image" uuid="4114a8d0-7213-4a1b-9537-08fa4aca9d21"/>
Jul 25 16:00:12 user nova-compute[70869]:       <nova:ports>
Jul 25 16:00:12 user nova-compute[70869]:         <nova:port uuid="3b8d729d-cca3-4f09-b96b-2219cd813371">
Jul 25 16:00:12 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 25 16:00:12 user nova-compute[70869]:         </nova:port>
Jul 25 16:00:12 user nova-compute[70869]:       </nova:ports>
Jul 25 16:00:12 user nova-compute[70869]:     </nova:instance>
Jul 25 16:00:12 user nova-compute[70869]:   </metadata>
Jul 25 16:00:12 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 16:00:12 user nova-compute[70869]:     <system>
Jul 25 16:00:12 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:00:12 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:00:12 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 16:00:12 user nova-compute[70869]:       <entry name="serial">bf860245-f481-4f4d-a478-ebde47c5d796</entry>
Jul 25 16:00:12 user nova-compute[70869]:       <entry name="uuid">bf860245-f481-4f4d-a478-ebde47c5d796</entry>
Jul 25 16:00:12 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:00:12 user nova-compute[70869]:     </system>
Jul 25 16:00:12 user nova-compute[70869]:   </sysinfo>
Jul 25 16:00:12 user nova-compute[70869]:   <os>
Jul 25 16:00:12 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:00:12 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 16:00:12 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 16:00:12 user nova-compute[70869]:   </os>
Jul 25 16:00:12 user nova-compute[70869]:   <features>
Jul 25 16:00:12 user nova-compute[70869]:     <acpi/>
Jul 25 16:00:12 user nova-compute[70869]:     <apic/>
Jul 25 16:00:12 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 16:00:12 user nova-compute[70869]:   </features>
Jul 25 16:00:12 user nova-compute[70869]:   <clock offset="utc">
Jul 25 16:00:12 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:00:12 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:00:12 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 16:00:12 user nova-compute[70869]:   </clock>
Jul 25 16:00:12 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 16:00:12 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 16:00:12 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:00:12 user nova-compute[70869]:   </cpu>
Jul 25 16:00:12 user nova-compute[70869]:   <devices>
Jul 25 16:00:12 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 16:00:12 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:00:12 user nova-compute[70869]:       <source dev="/dev/sde"/>
Jul 25 16:00:12 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 16:00:12 user nova-compute[70869]:       <serial>75d94404-4427-4600-b288-ad583bab1c5e</serial>
Jul 25 16:00:12 user nova-compute[70869]:     </disk>
Jul 25 16:00:12 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 16:00:12 user nova-compute[70869]:       <mac address="fa:16:3e:ec:1a:96"/>
Jul 25 16:00:12 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:00:12 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 16:00:12 user nova-compute[70869]:       <target dev="tap3b8d729d-cc"/>
Jul 25 16:00:12 user nova-compute[70869]:     </interface>
Jul 25 16:00:12 user nova-compute[70869]:     <serial type="pty">
Jul 25 16:00:12 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/bf860245-f481-4f4d-a478-ebde47c5d796/console.log" append="off"/>
Jul 25 16:00:12 user nova-compute[70869]:     </serial>
Jul 25 16:00:12 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:00:12 user nova-compute[70869]:     <video>
Jul 25 16:00:12 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:00:12 user nova-compute[70869]:     </video>
Jul 25 16:00:12 user nova-compute[70869]:     <rng model="virtio">
Jul 25 16:00:12 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:00:12 user nova-compute[70869]:     </rng>
Jul 25 16:00:12 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:00:12 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 16:00:12 user nova-compute[70869]:       <stats period="10"/>
Jul 25 16:00:12 user nova-compute[70869]:     </memballoon>
Jul 25 16:00:12 user nova-compute[70869]:   </devices>
Jul 25 16:00:12 user nova-compute[70869]: </domain>
Jul 25 16:00:12 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-40506904',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-40506904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-40506904',id=46,image_ref='4114a8d0-7213-4a1b-9537-08fa4aca9d21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGD2OEJSTgtYidRkWNvYnkHjF6SrNK2kM4erEC726LGKbhYVZLj7Z7EdyPP9KeOwwT/VcUlRL2BxvG30w2KXVaFKq42hhPyndrwzPHpuNlyejL8LymquL1RKgcvPohfVWg==',key_name='tempest-keypair-1458741157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-phyd3sse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1492727042',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T15:59:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=bf860245-f481-4f4d-a478-ebde47c5d796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:1a:96,bridge_name='br-int',has_traffic_filtering=True,id=3b8d729d-cca3-4f09-b96b-2219cd813371,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8d729d-cc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_vif [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:1a:96,bridge_name='br-int',has_traffic_filtering=True,id=3b8d729d-cca3-4f09-b96b-2219cd813371,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8d729d-cc') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b8d729d-cc, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b8d729d-cc, col_values=(('external_ids', {'iface-id': '3b8d729d-cca3-4f09-b96b-2219cd813371', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:1a:96', 'vm-uuid': 'bf860245-f481-4f4d-a478-ebde47c5d796'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:12 user nova-compute[70869]: INFO os_vif [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:1a:96,bridge_name='br-int',has_traffic_filtering=True,id=3b8d729d-cca3-4f09-b96b-2219cd813371,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8d729d-cc')
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[da880848-87a5-43d9-8450-8ce43caf2517]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:00:12 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:00:12 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:00:12 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:00:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:00:12 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:00:12 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:00:12 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:00:12 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c23dc60>, {}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Disconnecting from: [] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] <== disconnect_volume: return (870ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:00:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Deleting instance files /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef_del
Jul 25 16:00:12 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Deletion of /opt/stack/data/nova/instances/45fb4262-b025-4455-b3ac-4c1909c4d1ef_del complete
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:12 user nova-compute[70869]: INFO nova.compute.manager [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Took 1.79 seconds to destroy the instance on the hypervisor.
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:00:12 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Deleted allocations for instance bec5046f-9ed2-4813-8ab2-b2a61d37b2e5
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No VIF found with MAC fa:16:3e:ec:1a:96, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received event network-vif-plugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Acquiring lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] No waiting events found dispatching network-vif-plugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:12 user nova-compute[70869]: WARNING nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Received unexpected event network-vif-plugged-ed92dc75-b5d9-4bd5-8838-6205adf9349e for instance with vm_state deleted and task_state None.
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-unplugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] No waiting events found dispatching network-vif-unplugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-unplugged-ea89090c-ff7a-4492-81bd-0d948d382c03 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] No waiting events found dispatching network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:12 user nova-compute[70869]: WARNING nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received unexpected event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 for instance with vm_state active and task_state deleting.
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] No waiting events found dispatching network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:12 user nova-compute[70869]: WARNING nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received unexpected event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 for instance with vm_state active and task_state deleting.
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] No waiting events found dispatching network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:12 user nova-compute[70869]: WARNING nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received unexpected event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 for instance with vm_state active and task_state deleting.
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-unplugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] No waiting events found dispatching network-vif-unplugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-unplugged-ea89090c-ff7a-4492-81bd-0d948d382c03 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Acquiring lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:12 user nova-compute[70869]: DEBUG nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] No waiting events found dispatching network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:12 user nova-compute[70869]: WARNING nova.compute.manager [req-92f567c1-f236-47de-a5d3-3127177888d0 req-7065b39e-40b6-48b2-b8de-8991a1d9614b service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received unexpected event network-vif-plugged-ea89090c-ff7a-4492-81bd-0d948d382c03 for instance with vm_state active and task_state deleting.
Jul 25 16:00:12 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-15d07a74-b535-435e-b613-ef1c79afe939 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "bec5046f-9ed2-4813-8ab2-b2a61d37b2e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.430s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:13 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:13 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Took 0.79 seconds to deallocate network for instance.
Jul 25 16:00:13 user nova-compute[70869]: WARNING nova.volume.cinder [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Attachment d784416b-22aa-4ead-a50c-c7acb9e1b80f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d784416b-22aa-4ead-a50c-c7acb9e1b80f. (HTTP 404) (Request-ID: req-755ffdd6-33f0-420b-8c30-79c2d0f6f9b2)
Jul 25 16:00:13 user nova-compute[70869]: INFO nova.compute.manager [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Took 0.04 seconds to detach 1 volumes for instance.
Jul 25 16:00:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:13 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:13 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:00:13 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:14 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Deleted allocations for instance 45fb4262-b025-4455-b3ac-4c1909c4d1ef
Jul 25 16:00:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae79bbf1-6347-403a-877a-1aa6190b0bce tempest-VolumesSnapshotTestJSON-529637024 tempest-VolumesSnapshotTestJSON-529637024-project-member] Lock "45fb4262-b025-4455-b3ac-4c1909c4d1ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.139s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-114d4b74-e069-4d74-bb89-f6982f190a1e req-c8f5eac3-c09f-4bb4-b24c-29d1095cc65d service nova] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Received event network-vif-deleted-ea89090c-ff7a-4492-81bd-0d948d382c03 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-114d4b74-e069-4d74-bb89-f6982f190a1e req-c8f5eac3-c09f-4bb4-b24c-29d1095cc65d service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received event network-vif-plugged-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-114d4b74-e069-4d74-bb89-f6982f190a1e req-c8f5eac3-c09f-4bb4-b24c-29d1095cc65d service nova] Acquiring lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-114d4b74-e069-4d74-bb89-f6982f190a1e req-c8f5eac3-c09f-4bb4-b24c-29d1095cc65d service nova] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-114d4b74-e069-4d74-bb89-f6982f190a1e req-c8f5eac3-c09f-4bb4-b24c-29d1095cc65d service nova] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-114d4b74-e069-4d74-bb89-f6982f190a1e req-c8f5eac3-c09f-4bb4-b24c-29d1095cc65d service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] No waiting events found dispatching network-vif-plugged-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:14 user nova-compute[70869]: WARNING nova.compute.manager [req-114d4b74-e069-4d74-bb89-f6982f190a1e req-c8f5eac3-c09f-4bb4-b24c-29d1095cc65d service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received unexpected event network-vif-plugged-3b8d729d-cca3-4f09-b96b-2219cd813371 for instance with vm_state building and task_state spawning.
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300816.1306505, bf860245-f481-4f4d-a478-ebde47c5d796 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:00:16 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] VM Resumed (Lifecycle Event)
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:00:16 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Instance spawned successfully.
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:00:16 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300816.132928, bf860245-f481-4f4d-a478-ebde47c5d796 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:00:16 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] VM Started (Lifecycle Event)
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:00:16 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:00:16 user nova-compute[70869]: INFO nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Took 5.05 seconds to spawn the instance on the hypervisor.
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:00:16 user nova-compute[70869]: INFO nova.compute.manager [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Took 18.76 seconds to build instance.
Jul 25 16:00:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-667aad9b-2ba2-40ed-85a4-e434f6577b2d tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "bf860245-f481-4f4d-a478-ebde47c5d796" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.861s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-69971d12-e090-4202-8d3d-9cc17d726bac req-8c8cfec8-824c-40c8-82c1-33f35d024301 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received event network-vif-plugged-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-69971d12-e090-4202-8d3d-9cc17d726bac req-8c8cfec8-824c-40c8-82c1-33f35d024301 service nova] Acquiring lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-69971d12-e090-4202-8d3d-9cc17d726bac req-8c8cfec8-824c-40c8-82c1-33f35d024301 service nova] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-69971d12-e090-4202-8d3d-9cc17d726bac req-8c8cfec8-824c-40c8-82c1-33f35d024301 service nova] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-69971d12-e090-4202-8d3d-9cc17d726bac req-8c8cfec8-824c-40c8-82c1-33f35d024301 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] No waiting events found dispatching network-vif-plugged-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:16 user nova-compute[70869]: WARNING nova.compute.manager [req-69971d12-e090-4202-8d3d-9cc17d726bac req-8c8cfec8-824c-40c8-82c1-33f35d024301 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received unexpected event network-vif-plugged-3b8d729d-cca3-4f09-b96b-2219cd813371 for instance with vm_state active and task_state None.
Jul 25 16:00:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:26 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300811.1708965, bec5046f-9ed2-4813-8ab2-b2a61d37b2e5 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:00:26 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] VM Stopped (Lifecycle Event)
Jul 25 16:00:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e71a11c5-6581-4b5b-b319-e8ad38021b36 None None] [instance: bec5046f-9ed2-4813-8ab2-b2a61d37b2e5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:00:26 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300811.7853498, 45fb4262-b025-4455-b3ac-4c1909c4d1ef => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:00:26 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] VM Stopped (Lifecycle Event)
Jul 25 16:00:26 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7fb47cd6-b49f-48db-aece-e6ac9d372529 None None] [instance: 45fb4262-b025-4455-b3ac-4c1909c4d1ef] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:00:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-10b3b2d1-e9a0-45fc-98bb-ae172642b566 req-272504e7-7a42-40c2-bc7c-ab8fac7e27ae service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received event network-changed-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-10b3b2d1-e9a0-45fc-98bb-ae172642b566 req-272504e7-7a42-40c2-bc7c-ab8fac7e27ae service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Refreshing instance network info cache due to event network-changed-03bf466d-6664-4d76-9140-5fcc289b5528. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-10b3b2d1-e9a0-45fc-98bb-ae172642b566 req-272504e7-7a42-40c2-bc7c-ab8fac7e27ae service nova] Acquiring lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-10b3b2d1-e9a0-45fc-98bb-ae172642b566 req-272504e7-7a42-40c2-bc7c-ab8fac7e27ae service nova] Acquired lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-10b3b2d1-e9a0-45fc-98bb-ae172642b566 req-272504e7-7a42-40c2-bc7c-ab8fac7e27ae service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Refreshing network info cache for port 03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:33 user nova-compute[70869]: INFO nova.compute.manager [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Terminating instance
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-10b3b2d1-e9a0-45fc-98bb-ae172642b566 req-272504e7-7a42-40c2-bc7c-ab8fac7e27ae service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updated VIF entry in instance network info cache for port 03bf466d-6664-4d76-9140-5fcc289b5528. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-10b3b2d1-e9a0-45fc-98bb-ae172642b566 req-272504e7-7a42-40c2-bc7c-ab8fac7e27ae service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updating instance_info_cache with network_info: [{"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-10b3b2d1-e9a0-45fc-98bb-ae172642b566 req-272504e7-7a42-40c2-bc7c-ab8fac7e27ae service nova] Releasing lock "refresh_cache-263aedd4-9dbd-4232-986a-e250505153e5" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:00:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Instance destroyed successfully.
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.objects.instance [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lazy-loading 'resources' on Instance uuid 263aedd4-9dbd-4232-986a-e250505153e5 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-327261695',display_name='tempest-TestStampPattern-server-327261695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-327261695',id=37,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElU+k0rYhronu9BRexD90+MpLjOziUBLG+MBblKgeyeqhBtK3ZZxmOSTMgIcyGCVGFadf5Axe2ypZfEAo6F7i3fDoJINEYS2h5LlPs+FC+P6iRvLoE5Lhlii2I+TRFzJg==',key_name='tempest-TestStampPattern-1826637939',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43515216642447938c73f1a2536d095b',ramdisk_id='',reservation_id='r-91crjekq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1006666307',owner_user_name='tempest-TestStampPattern-1006666307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:56:36Z,user_data=None,user_id='e9fac4d2818f46dc82613cf63b921a1b',uuid=263aedd4-9dbd-4232-986a-e250505153e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converting VIF {"id": "03bf466d-6664-4d76-9140-5fcc289b5528", "address": "fa:16:3e:4b:33:8a", "network": {"id": "f0f258aa-4cf7-4134-b96c-2e2e8525e150", "bridge": "br-int", "label": "tempest-TestStampPattern-305428117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43515216642447938c73f1a2536d095b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bf466d-66", "ovs_interfaceid": "03bf466d-6664-4d76-9140-5fcc289b5528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=03bf466d-6664-4d76-9140-5fcc289b5528,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf466d-66') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG os_vif [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=03bf466d-6664-4d76-9140-5fcc289b5528,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf466d-66') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03bf466d-66, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:00:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:00:33 user nova-compute[70869]: INFO os_vif [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=03bf466d-6664-4d76-9140-5fcc289b5528,network=Network(f0f258aa-4cf7-4134-b96c-2e2e8525e150),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03bf466d-66')
Jul 25 16:00:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Deleting instance files /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5_del
Jul 25 16:00:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Deletion of /opt/stack/data/nova/instances/263aedd4-9dbd-4232-986a-e250505153e5_del complete
Jul 25 16:00:34 user nova-compute[70869]: INFO nova.compute.manager [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 25 16:00:34 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:34 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Took 0.42 seconds to deallocate network for instance.
Jul 25 16:00:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-4bc72774-2c16-497b-8fa5-785909323564 req-777ffcc4-a1e8-4430-8c4f-eee212750269 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received event network-vif-deleted-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:34 user nova-compute[70869]: INFO nova.compute.manager [req-4bc72774-2c16-497b-8fa5-785909323564 req-777ffcc4-a1e8-4430-8c4f-eee212750269 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Neutron deleted interface 03bf466d-6664-4d76-9140-5fcc289b5528; detaching it from the instance and deleting it from the info cache
Jul 25 16:00:34 user nova-compute[70869]: DEBUG nova.network.neutron [req-4bc72774-2c16-497b-8fa5-785909323564 req-777ffcc4-a1e8-4430-8c4f-eee212750269 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-4bc72774-2c16-497b-8fa5-785909323564 req-777ffcc4-a1e8-4430-8c4f-eee212750269 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Detach interface failed, port_id=03bf466d-6664-4d76-9140-5fcc289b5528, reason: Instance 263aedd4-9dbd-4232-986a-e250505153e5 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:00:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:34 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Deleted allocations for instance 263aedd4-9dbd-4232-986a-e250505153e5
Jul 25 16:00:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-1dc9d463-e5cd-41e1-841a-5d18dfeae1ae tempest-TestStampPattern-1006666307 tempest-TestStampPattern-1006666307-project-member] Lock "263aedd4-9dbd-4232-986a-e250505153e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.666s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received event network-vif-unplugged-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] No waiting events found dispatching network-vif-unplugged-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:35 user nova-compute[70869]: WARNING nova.compute.manager [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received unexpected event network-vif-unplugged-03bf466d-6664-4d76-9140-5fcc289b5528 for instance with vm_state deleted and task_state None.
Jul 25 16:00:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received event network-vif-plugged-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:00:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] Acquiring lock "263aedd4-9dbd-4232-986a-e250505153e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] Lock "263aedd4-9dbd-4232-986a-e250505153e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] No waiting events found dispatching network-vif-plugged-03bf466d-6664-4d76-9140-5fcc289b5528 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:00:35 user nova-compute[70869]: WARNING nova.compute.manager [req-cc61584f-937c-4840-b200-ba1a5ea7675f req-6f48ebc8-4bbf-47fd-b248-c57d74eed1d9 service nova] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Received unexpected event network-vif-plugged-03bf466d-6664-4d76-9140-5fcc289b5528 for instance with vm_state deleted and task_state None.
Jul 25 16:00:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:46 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:00:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:46 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:00:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:00:48 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:00:48 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8055MB free_disk=25.291645050048828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d1ecb257-072c-4d1c-b2c4-15486ae66936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 835a1495-de8c-4649-a4ef-266be7914aa6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf860245-f481-4f4d-a478-ebde47c5d796 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300833.94961, 263aedd4-9dbd-4232-986a-e250505153e5 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:00:48 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] VM Stopped (Lifecycle Event)
Jul 25 16:00:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-32980610-59e1-4a1d-8cba-0eae7d9b0e99 None None] [instance: 263aedd4-9dbd-4232-986a-e250505153e5] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:00:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:49 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:00:49 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:00:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:00:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:00:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:00:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:00:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:00:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:00:52 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating instance_info_cache with network_info: [{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:00:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:00:55 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:00:56 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:00:58 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:00:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:00 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:01:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:01 user nova-compute[70869]: INFO nova.compute.manager [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Detaching volume 53bb1859-642d-413d-b07e-1fbca16949d2
Jul 25 16:01:02 user nova-compute[70869]: INFO nova.virt.block_device [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Attempting to driver detach volume 53bb1859-642d-413d-b07e-1fbca16949d2 from mountpoint /dev/vdb
Jul 25 16:01:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Attempting to detach device vdb from instance 835a1495-de8c-4649-a4ef-266be7914aa6 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:01:02 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:01:02 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 16:01:02 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:01:02 user nova-compute[70869]:   <serial>53bb1859-642d-413d-b07e-1fbca16949d2</serial>
Jul 25 16:01:02 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:01:02 user nova-compute[70869]: </disk>
Jul 25 16:01:02 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:01:02 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully detached device vdb from instance 835a1495-de8c-4649-a4ef-266be7914aa6 from the persistent domain config.
Jul 25 16:01:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 835a1495-de8c-4649-a4ef-266be7914aa6 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:01:02 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:01:02 user nova-compute[70869]:   <source dev="/dev/sdd"/>
Jul 25 16:01:02 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:01:02 user nova-compute[70869]:   <serial>53bb1859-642d-413d-b07e-1fbca16949d2</serial>
Jul 25 16:01:02 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:01:02 user nova-compute[70869]: </disk>
Jul 25 16:01:02 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300862.5174842, 835a1495-de8c-4649-a4ef-266be7914aa6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 835a1495-de8c-4649-a4ef-266be7914aa6 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:01:02 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully detached device vdb from instance 835a1495-de8c-4649-a4ef-266be7914aa6 from the live domain config.
Jul 25 16:01:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVrKalqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:01:02 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e093d857-92d7-4c59-bd22-76933cbe7c1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:01:02 user nova-compute[70869]: No targets found.
Jul 25 16:01:02 user nova-compute[70869]: iSNS:
Jul 25 16:01:02 user nova-compute[70869]: No targets found.
Jul 25 16:01:02 user nova-compute[70869]: STATIC:
Jul 25 16:01:02 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e
Jul 25 16:01:02 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:01:02 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:01:02 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e
Jul 25 16:01:02 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:01:02 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:01:02 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e
Jul 25 16:01:02 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:01:02 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:01:02 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2
Jul 25 16:01:02 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:01:02 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:01:02 user nova-compute[70869]: FIRMWARE:
Jul 25 16:01:02 user nova-compute[70869]: No targets found.
Jul 25 16:01:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:01:02 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:01:02 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d296a077-e567-405f-b31f-10684b559a35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e942a59-5888-4345-a0fc-cd7ed73c5df1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:01:02 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:01:02 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:01:02 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:01:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:01:02 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:01:02 user nova-compute[70869]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 (non-flash)
Jul 25 16:01:02 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:01:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe41c5dd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb70f54-5641-4069-b8a4-40fb269d4324]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[53166083-cc5a-489c-a355-c1677edee098]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5626f5f-8603-4829-831d-320c9dc8e21d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[950c3401-be92-4682-9b57-133ea6e533b0]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e23536-e338-48c2-a6c7-243dc0f96a28]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce962397-1383-4fcf-acaf-249b6f3be38a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2, portal: 172.16.0.220,3260]
Jul 25 16:01:02 user nova-compute[70869]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2, portal: 172.16.0.220,3260] successful.
Jul 25 16:01:02 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53bb1859-642d-413d-b07e-1fbca16949d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fa101e-d93a-43ce-bb63-6d0b58969dbf]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] <== disconnect_volume: return (325ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:01:02 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:01:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:01:05 user nova-compute[70869]: DEBUG nova.objects.instance [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'flavor' on Instance uuid 835a1495-de8c-4649-a4ef-266be7914aa6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:01:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-89da1770-7085-42e0-93ba-01583c0f48be tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.640s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:01:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-cda3e75f-78b0-4dfa-b358-0833e00934ea req-312b40d6-c032-468d-89e8-8e5b89342543 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-changed-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:01:23 user nova-compute[70869]: DEBUG nova.compute.manager [req-cda3e75f-78b0-4dfa-b358-0833e00934ea req-312b40d6-c032-468d-89e8-8e5b89342543 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Refreshing instance network info cache due to event network-changed-c0288dd3-2116-4c18-a4ca-73e0399ec75a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:01:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cda3e75f-78b0-4dfa-b358-0833e00934ea req-312b40d6-c032-468d-89e8-8e5b89342543 service nova] Acquiring lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:01:23 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cda3e75f-78b0-4dfa-b358-0833e00934ea req-312b40d6-c032-468d-89e8-8e5b89342543 service nova] Acquired lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:01:23 user nova-compute[70869]: DEBUG nova.network.neutron [req-cda3e75f-78b0-4dfa-b358-0833e00934ea req-312b40d6-c032-468d-89e8-8e5b89342543 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Refreshing network info cache for port c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:01:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:24 user nova-compute[70869]: INFO nova.compute.manager [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Detaching volume 9f98983e-79aa-4fa3-9704-42cb7ca6b64e
Jul 25 16:01:24 user nova-compute[70869]: DEBUG nova.network.neutron [req-cda3e75f-78b0-4dfa-b358-0833e00934ea req-312b40d6-c032-468d-89e8-8e5b89342543 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updated VIF entry in instance network info cache for port c0288dd3-2116-4c18-a4ca-73e0399ec75a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG nova.network.neutron [req-cda3e75f-78b0-4dfa-b358-0833e00934ea req-312b40d6-c032-468d-89e8-8e5b89342543 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating instance_info_cache with network_info: [{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-cda3e75f-78b0-4dfa-b358-0833e00934ea req-312b40d6-c032-468d-89e8-8e5b89342543 service nova] Releasing lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:01:24 user nova-compute[70869]: INFO nova.virt.block_device [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Attempting to driver detach volume 9f98983e-79aa-4fa3-9704-42cb7ca6b64e from mountpoint /dev/vdb
Jul 25 16:01:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Attempting to detach device vdb from instance d1ecb257-072c-4d1c-b2c4-15486ae66936 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:01:24 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:01:24 user nova-compute[70869]:   <source dev="/dev/sdb"/>
Jul 25 16:01:24 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:01:24 user nova-compute[70869]:   <serial>9f98983e-79aa-4fa3-9704-42cb7ca6b64e</serial>
Jul 25 16:01:24 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:01:24 user nova-compute[70869]: </disk>
Jul 25 16:01:24 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:01:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Successfully detached device vdb from instance d1ecb257-072c-4d1c-b2c4-15486ae66936 from the persistent domain config.
Jul 25 16:01:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d1ecb257-072c-4d1c-b2c4-15486ae66936 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:01:24 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:01:24 user nova-compute[70869]:   <source dev="/dev/sdb"/>
Jul 25 16:01:24 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:01:24 user nova-compute[70869]:   <serial>9f98983e-79aa-4fa3-9704-42cb7ca6b64e</serial>
Jul 25 16:01:24 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:01:24 user nova-compute[70869]: </disk>
Jul 25 16:01:24 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690300884.7450192, d1ecb257-072c-4d1c-b2c4-15486ae66936 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:01:24 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Successfully detached device vdb from instance d1ecb257-072c-4d1c-b2c4-15486ae66936 from the live domain config.
Jul 25 16:01:24 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'urDxaqFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:01:24 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3a9ae2-7445-4b57-97ec-2576603d3201]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:01:24 user nova-compute[70869]: No targets found.
Jul 25 16:01:24 user nova-compute[70869]: iSNS:
Jul 25 16:01:24 user nova-compute[70869]: No targets found.
Jul 25 16:01:24 user nova-compute[70869]: STATIC:
Jul 25 16:01:24 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e
Jul 25 16:01:24 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:01:24 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:01:24 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e
Jul 25 16:01:24 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:01:24 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:01:24 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e
Jul 25 16:01:24 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:01:24 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:01:24 user nova-compute[70869]: FIRMWARE:
Jul 25 16:01:24 user nova-compute[70869]: No targets found.
Jul 25 16:01:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:01:24 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:01:24 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[76761e8e-b185-484e-8c16-403d48c79219]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dca1233-eb3b-4b1f-9146-93f0d053aa39]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:01:24 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:01:24 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:01:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e (non-flash)
Jul 25 16:01:24 user nova-compute[70869]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:01:24 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:01:24 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe434118790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e'): ({'sdb'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Removing single pathed devices sdb {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[833b6c35-4115-4fb3-8fc9-1e293cd3b154]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea5c15a-08d3-4bdd-85dc-d9c0439a4b2c]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Flushing IO for device /dev/sdb {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[203b561e-4e90-4ed1-91b9-ecc93c89aaba]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bbf3ad-f162-4939-9dbb-50fc99291f17]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8d06e5-f40b-42e2-93fa-edc55246240a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:01:24 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9de3b3a-ac1a-49bb-8f97-23578e355335]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e, portal: 172.16.0.220,3260]
Jul 25 16:01:25 user nova-compute[70869]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e, portal: 172.16.0.220,3260] successful.
Jul 25 16:01:25 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f98983e-79aa-4fa3-9704-42cb7ca6b64e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c9f9f0-606d-43ca-ab0b-4bd27090a492]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] <== disconnect_volume: return (310ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-b2c29b43-4380-4468-93bd-d2551569594e req-319a1ff5-04cc-41bb-a425-87a77c36354f service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-changed-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-b2c29b43-4380-4468-93bd-d2551569594e req-319a1ff5-04cc-41bb-a425-87a77c36354f service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Refreshing instance network info cache due to event network-changed-c0288dd3-2116-4c18-a4ca-73e0399ec75a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b2c29b43-4380-4468-93bd-d2551569594e req-319a1ff5-04cc-41bb-a425-87a77c36354f service nova] Acquiring lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b2c29b43-4380-4468-93bd-d2551569594e req-319a1ff5-04cc-41bb-a425-87a77c36354f service nova] Acquired lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG nova.network.neutron [req-b2c29b43-4380-4468-93bd-d2551569594e req-319a1ff5-04cc-41bb-a425-87a77c36354f service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Refreshing network info cache for port c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:01:25 user nova-compute[70869]: DEBUG nova.objects.instance [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'flavor' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:01:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-10e8a264-f4b2-4bc1-9535-4cbaf984a687 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.913s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:26 user nova-compute[70869]: DEBUG nova.network.neutron [req-b2c29b43-4380-4468-93bd-d2551569594e req-319a1ff5-04cc-41bb-a425-87a77c36354f service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updated VIF entry in instance network info cache for port c0288dd3-2116-4c18-a4ca-73e0399ec75a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:01:26 user nova-compute[70869]: DEBUG nova.network.neutron [req-b2c29b43-4380-4468-93bd-d2551569594e req-319a1ff5-04cc-41bb-a425-87a77c36354f service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating instance_info_cache with network_info: [{"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:01:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b2c29b43-4380-4468-93bd-d2551569594e req-319a1ff5-04cc-41bb-a425-87a77c36354f service nova] Releasing lock "refresh_cache-d1ecb257-072c-4d1c-b2c4-15486ae66936" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:01:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:47 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:01:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:01:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG nova.compute.manager [req-d507dac8-9eee-40a7-bdc0-df1fd6ff8e4b req-2da033f7-44d4-4c1a-8389-c0dcac0f5a8a service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received event network-changed-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG nova.compute.manager [req-d507dac8-9eee-40a7-bdc0-df1fd6ff8e4b req-2da033f7-44d4-4c1a-8389-c0dcac0f5a8a service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Refreshing instance network info cache due to event network-changed-3b8d729d-cca3-4f09-b96b-2219cd813371. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d507dac8-9eee-40a7-bdc0-df1fd6ff8e4b req-2da033f7-44d4-4c1a-8389-c0dcac0f5a8a service nova] Acquiring lock "refresh_cache-bf860245-f481-4f4d-a478-ebde47c5d796" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d507dac8-9eee-40a7-bdc0-df1fd6ff8e4b req-2da033f7-44d4-4c1a-8389-c0dcac0f5a8a service nova] Acquired lock "refresh_cache-bf860245-f481-4f4d-a478-ebde47c5d796" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG nova.network.neutron [req-d507dac8-9eee-40a7-bdc0-df1fd6ff8e4b req-2da033f7-44d4-4c1a-8389-c0dcac0f5a8a service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Refreshing network info cache for port 3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.network.neutron [req-d507dac8-9eee-40a7-bdc0-df1fd6ff8e4b req-2da033f7-44d4-4c1a-8389-c0dcac0f5a8a service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Updated VIF entry in instance network info cache for port 3b8d729d-cca3-4f09-b96b-2219cd813371. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.network.neutron [req-d507dac8-9eee-40a7-bdc0-df1fd6ff8e4b req-2da033f7-44d4-4c1a-8389-c0dcac0f5a8a service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Updating instance_info_cache with network_info: [{"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d507dac8-9eee-40a7-bdc0-df1fd6ff8e4b req-2da033f7-44d4-4c1a-8389-c0dcac0f5a8a service nova] Releasing lock "refresh_cache-bf860245-f481-4f4d-a478-ebde47c5d796" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:01:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8247MB free_disk=25.28116226196289GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d1ecb257-072c-4d1c-b2c4-15486ae66936 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 835a1495-de8c-4649-a4ef-266be7914aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance bf860245-f481-4f4d-a478-ebde47c5d796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:01:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "bf860245-f481-4f4d-a478-ebde47c5d796" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "bf860245-f481-4f4d-a478-ebde47c5d796" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:50 user nova-compute[70869]: INFO nova.compute.manager [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Terminating instance
Jul 25 16:01:50 user nova-compute[70869]: DEBUG nova.compute.manager [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-88e12840-3521-4640-bdf5-433842d73cf4 req-65b5b8b6-3fac-4ab7-85d3-bd08b217a49c service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received event network-vif-unplugged-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-88e12840-3521-4640-bdf5-433842d73cf4 req-65b5b8b6-3fac-4ab7-85d3-bd08b217a49c service nova] Acquiring lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-88e12840-3521-4640-bdf5-433842d73cf4 req-65b5b8b6-3fac-4ab7-85d3-bd08b217a49c service nova] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-88e12840-3521-4640-bdf5-433842d73cf4 req-65b5b8b6-3fac-4ab7-85d3-bd08b217a49c service nova] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-88e12840-3521-4640-bdf5-433842d73cf4 req-65b5b8b6-3fac-4ab7-85d3-bd08b217a49c service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] No waiting events found dispatching network-vif-unplugged-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-88e12840-3521-4640-bdf5-433842d73cf4 req-65b5b8b6-3fac-4ab7-85d3-bd08b217a49c service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received event network-vif-unplugged-3b8d729d-cca3-4f09-b96b-2219cd813371 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:01:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Instance destroyed successfully.
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.objects.instance [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'resources' on Instance uuid bf860245-f481-4f4d-a478-ebde47c5d796 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-40506904',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-40506904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-40506904',id=46,image_ref='4114a8d0-7213-4a1b-9537-08fa4aca9d21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGD2OEJSTgtYidRkWNvYnkHjF6SrNK2kM4erEC726LGKbhYVZLj7Z7EdyPP9KeOwwT/VcUlRL2BxvG30w2KXVaFKq42hhPyndrwzPHpuNlyejL8LymquL1RKgcvPohfVWg==',key_name='tempest-keypair-1458741157',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:00:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-phyd3sse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1492727042',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:00:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=bf860245-f481-4f4d-a478-ebde47c5d796,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "3b8d729d-cca3-4f09-b96b-2219cd813371", "address": "fa:16:3e:ec:1a:96", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b8d729d-cc", "ovs_interfaceid": "3b8d729d-cca3-4f09-b96b-2219cd813371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:1a:96,bridge_name='br-int',has_traffic_filtering=True,id=3b8d729d-cca3-4f09-b96b-2219cd813371,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8d729d-cc') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_vif [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:1a:96,bridge_name='br-int',has_traffic_filtering=True,id=3b8d729d-cca3-4f09-b96b-2219cd813371,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8d729d-cc') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b8d729d-cc, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:51 user nova-compute[70869]: INFO os_vif [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:1a:96,bridge_name='br-int',has_traffic_filtering=True,id=3b8d729d-cca3-4f09-b96b-2219cd813371,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b8d729d-cc')
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUetgqGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:01:51 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4a0a33-91be-4516-b1c5-5e9029ec54ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:01:51 user nova-compute[70869]: No targets found.
Jul 25 16:01:51 user nova-compute[70869]: iSNS:
Jul 25 16:01:51 user nova-compute[70869]: No targets found.
Jul 25 16:01:51 user nova-compute[70869]: STATIC:
Jul 25 16:01:51 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e
Jul 25 16:01:51 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:01:51 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:01:51 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e
Jul 25 16:01:51 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:01:51 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:01:51 user nova-compute[70869]: FIRMWARE:
Jul 25 16:01:51 user nova-compute[70869]: No targets found.
Jul 25 16:01:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:01:51 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:01:51 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ecbe54-5290-47cc-8c86-87f1c2d57c85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3538da-4774-40d5-92b3-c8842d3387d1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:01:51 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:01:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:01:51 user nova-compute[70869]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e (non-flash)
Jul 25 16:01:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4431b1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e'): ({'sde'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Removing single pathed devices sde {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a9b8e-92a7-4974-8ee2-1ccb592aa33c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a302f1-9ccc-4b0a-864b-249d38c928f5]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flushing IO for device /dev/sde {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e4d0cf-d9df-498b-bb7d-cd1e8f30ecd4]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9739ad-1e8c-479a-a856-a6f03e1ce689]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] SCSI volumes sde have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdbed8000-0ca824ef890e64af', '/dev/disk/by-id/scsi-23063613832346566', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_dbed8000') {{(pid=82054) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9da5fbe-6729-45b1-80b3-6cb7943288c3]: (4, None) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060f901-6b2c-4914-9ac9-2d05bbfcceea]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1833c26-d28f-4e6e-8532-f9999bd67de5]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e, portal: 172.16.0.220,3260]
Jul 25 16:01:51 user nova-compute[70869]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e, portal: 172.16.0.220,3260] successful.
Jul 25 16:01:51 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d94404-4427-4600-b288-ad583bab1c5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8fbc0e-b33c-4166-a43e-d1b6fa2b4f83]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== disconnect_volume: return (345ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:01:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Deleting instance files /opt/stack/data/nova/instances/bf860245-f481-4f4d-a478-ebde47c5d796_del
Jul 25 16:01:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Deletion of /opt/stack/data/nova/instances/bf860245-f481-4f4d-a478-ebde47c5d796_del complete
Jul 25 16:01:51 user nova-compute[70869]: INFO nova.compute.manager [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 25 16:01:51 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:01:51 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:01:52 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:01:52 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Took 0.81 seconds to deallocate network for instance.
Jul 25 16:01:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:52 user nova-compute[70869]: INFO nova.compute.manager [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Terminating instance
Jul 25 16:01:52 user nova-compute[70869]: DEBUG nova.compute.manager [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:01:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received event network-vif-plugged-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] Acquiring lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] Lock "bf860245-f481-4f4d-a478-ebde47c5d796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] No waiting events found dispatching network-vif-plugged-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:01:53 user nova-compute[70869]: WARNING nova.compute.manager [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received unexpected event network-vif-plugged-3b8d729d-cca3-4f09-b96b-2219cd813371 for instance with vm_state active and task_state deleting.
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Received event network-vif-deleted-3b8d729d-cca3-4f09-b96b-2219cd813371 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received event network-vif-unplugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] No waiting events found dispatching network-vif-unplugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-db4dc534-4bc6-4e8e-802e-979e9749605c req-01159360-b49c-4237-9e78-4c0c397d5a99 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received event network-vif-unplugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:01:53 user nova-compute[70869]: INFO nova.compute.manager [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Took 0.92 seconds to detach 1 volumes for instance.
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Deleting volume: 75d94404-4427-4600-b288-ad583bab1c5e {{(pid=70869) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Instance destroyed successfully.
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'resources' on Instance uuid 835a1495-de8c-4649-a4ef-266be7914aa6 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1023810021',display_name='tempest-AttachVolumeNegativeTest-server-1023810021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1023810021',id=41,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/sFxPcMJDwzu+7wilF4FKL9TvR/JWD1Bvjv6agcmrndNWKPZHbG12A7+Yy5z6ApihBRwfx3JXoNxdiw2g8eZNR4n2jIc67xv5e/o627eiSTdJuR0nP3D8KZ36RfVaXg==',key_name='tempest-keypair-2040054052',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:56:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-q762bx0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=835a1495-de8c-4649-a4ef-266be7914aa6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "address": "fa:16:3e:c5:32:c8", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496ed94-10", "ovs_interfaceid": "5496ed94-107b-47ab-8c7a-6fb636ec7d5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=5496ed94-107b-47ab-8c7a-6fb636ec7d5a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496ed94-10') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG os_vif [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=5496ed94-107b-47ab-8c7a-6fb636ec7d5a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496ed94-10') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5496ed94-10, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:01:53 user nova-compute[70869]: INFO os_vif [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=5496ed94-107b-47ab-8c7a-6fb636ec7d5a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496ed94-10')
Jul 25 16:01:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Deleting instance files /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6_del
Jul 25 16:01:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Deletion of /opt/stack/data/nova/instances/835a1495-de8c-4649-a4ef-266be7914aa6_del complete
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:53 user nova-compute[70869]: INFO nova.compute.manager [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Took 1.08 seconds to destroy the instance on the hypervisor.
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:01:53 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:01:53 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Deleted allocations for instance bf860245-f481-4f4d-a478-ebde47c5d796
Jul 25 16:01:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-83eaca4d-177b-42a8-9065-6aef58ff6a91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "bf860245-f481-4f4d-a478-ebde47c5d796" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.634s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Skipping network cache update for instance because it is being deleted. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9871}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:01:54 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Took 0.96 seconds to deallocate network for instance.
Jul 25 16:01:54 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Updating instance_info_cache with network_info: [{"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:01:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:01:55 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:01:55 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:01:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:55 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Deleted allocations for instance 835a1495-de8c-4649-a4ef-266be7914aa6
Jul 25 16:01:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-c4b838aa-67ce-408e-83b1-1d8c9fc66adf req-4ad67f54-45f1-4509-b2e9-15b91e1a5dd3 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received event network-vif-plugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:01:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c4b838aa-67ce-408e-83b1-1d8c9fc66adf req-4ad67f54-45f1-4509-b2e9-15b91e1a5dd3 service nova] Acquiring lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:01:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c4b838aa-67ce-408e-83b1-1d8c9fc66adf req-4ad67f54-45f1-4509-b2e9-15b91e1a5dd3 service nova] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:01:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-c4b838aa-67ce-408e-83b1-1d8c9fc66adf req-4ad67f54-45f1-4509-b2e9-15b91e1a5dd3 service nova] Lock "835a1495-de8c-4649-a4ef-266be7914aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-c4b838aa-67ce-408e-83b1-1d8c9fc66adf req-4ad67f54-45f1-4509-b2e9-15b91e1a5dd3 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] No waiting events found dispatching network-vif-plugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:01:55 user nova-compute[70869]: WARNING nova.compute.manager [req-c4b838aa-67ce-408e-83b1-1d8c9fc66adf req-4ad67f54-45f1-4509-b2e9-15b91e1a5dd3 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received unexpected event network-vif-plugged-5496ed94-107b-47ab-8c7a-6fb636ec7d5a for instance with vm_state deleted and task_state None.
Jul 25 16:01:55 user nova-compute[70869]: DEBUG nova.compute.manager [req-c4b838aa-67ce-408e-83b1-1d8c9fc66adf req-4ad67f54-45f1-4509-b2e9-15b91e1a5dd3 service nova] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Received event network-vif-deleted-5496ed94-107b-47ab-8c7a-6fb636ec7d5a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:01:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-0f20eff3-9ff1-412a-831b-4b10cf0f11f2 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "835a1495-de8c-4649-a4ef-266be7914aa6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:01:57 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:01:57 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:01:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:01:58 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:01:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:01 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:06 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300911.1170783, bf860245-f481-4f4d-a478-ebde47c5d796 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:02:06 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] VM Stopped (Lifecycle Event)
Jul 25 16:02:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-988c0073-d2d8-4256-9632-f084e4552e19 None None] [instance: bf860245-f481-4f4d-a478-ebde47c5d796] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:02:08 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300913.6494186, 835a1495-de8c-4649-a4ef-266be7914aa6 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:02:08 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] VM Stopped (Lifecycle Event)
Jul 25 16:02:08 user nova-compute[70869]: DEBUG nova.compute.manager [None req-9bf94604-3c8b-4f40-b4eb-158970192b60 None None] [instance: 835a1495-de8c-4649-a4ef-266be7914aa6] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:02:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:02:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:02:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:02:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:02:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:08 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:14 user nova-compute[70869]: INFO nova.compute.manager [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Terminating instance
Jul 25 16:02:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-9334109f-d9d6-4d0a-ad95-6d7752bbb6fa req-ff66f734-5e1d-4f01-940c-f1f7cfcc8892 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-unplugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9334109f-d9d6-4d0a-ad95-6d7752bbb6fa req-ff66f734-5e1d-4f01-940c-f1f7cfcc8892 service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9334109f-d9d6-4d0a-ad95-6d7752bbb6fa req-ff66f734-5e1d-4f01-940c-f1f7cfcc8892 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9334109f-d9d6-4d0a-ad95-6d7752bbb6fa req-ff66f734-5e1d-4f01-940c-f1f7cfcc8892 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-9334109f-d9d6-4d0a-ad95-6d7752bbb6fa req-ff66f734-5e1d-4f01-940c-f1f7cfcc8892 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-unplugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:02:14 user nova-compute[70869]: DEBUG nova.compute.manager [req-9334109f-d9d6-4d0a-ad95-6d7752bbb6fa req-ff66f734-5e1d-4f01-940c-f1f7cfcc8892 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-unplugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Instance destroyed successfully.
Jul 25 16:02:15 user nova-compute[70869]: DEBUG nova.objects.instance [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'resources' on Instance uuid d1ecb257-072c-4d1c-b2c4-15486ae66936 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-559644806',display_name='tempest-ServerRescueNegativeTestJSON-server-559644806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-559644806',id=40,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI55a/pQOkt4Tpq7XzFSm0RXwMcragZEINMMx5bH6wRpqEvEt+C2XtIRdMumsJQPQfpcR4P41cr4GQZnzKTayL60NBWP94WnXczzsvLvFMheqv8lIDYmCgKAIWRJLX7JCA==',key_name='tempest-keypair-1296961173',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-d94ycp9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cee3181b38f451a929907b0250f7ae0',uuid=d1ecb257-072c-4d1c-b2c4-15486ae66936,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "address": "fa:16:3e:8c:c9:d0", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0288dd3-21", "ovs_interfaceid": "c0288dd3-2116-4c18-a4ca-73e0399ec75a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0288dd3-2116-4c18-a4ca-73e0399ec75a,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0288dd3-21') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG os_vif [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0288dd3-2116-4c18-a4ca-73e0399ec75a,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0288dd3-21') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0288dd3-21, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:02:15 user nova-compute[70869]: INFO os_vif [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=c0288dd3-2116-4c18-a4ca-73e0399ec75a,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0288dd3-21')
Jul 25 16:02:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Deleting instance files /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936_del
Jul 25 16:02:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Deletion of /opt/stack/data/nova/instances/d1ecb257-072c-4d1c-b2c4-15486ae66936_del complete
Jul 25 16:02:15 user nova-compute[70869]: INFO nova.compute.manager [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 25 16:02:15 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:02:16 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Took 1.00 seconds to deallocate network for instance.
Jul 25 16:02:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-5b474b80-f8a6-4b3d-adda-d810472d519b req-032587dc-b9a9-4bcf-bf8a-648fcbabd69a service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-deleted-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:16 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Deleted allocations for instance d1ecb257-072c-4d1c-b2c4-15486ae66936
Jul 25 16:02:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-2ed431d6-184b-4f54-9bcc-52624ec73b6a tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-db0492a6-dc09-4104-8084-62998cb4a0ea req-590eae3a-14ba-4666-9cf7-f308c121c650 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-db0492a6-dc09-4104-8084-62998cb4a0ea req-590eae3a-14ba-4666-9cf7-f308c121c650 service nova] Acquiring lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-db0492a6-dc09-4104-8084-62998cb4a0ea req-590eae3a-14ba-4666-9cf7-f308c121c650 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-db0492a6-dc09-4104-8084-62998cb4a0ea req-590eae3a-14ba-4666-9cf7-f308c121c650 service nova] Lock "d1ecb257-072c-4d1c-b2c4-15486ae66936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:16 user nova-compute[70869]: DEBUG nova.compute.manager [req-db0492a6-dc09-4104-8084-62998cb4a0ea req-590eae3a-14ba-4666-9cf7-f308c121c650 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] No waiting events found dispatching network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:02:16 user nova-compute[70869]: WARNING nova.compute.manager [req-db0492a6-dc09-4104-8084-62998cb4a0ea req-590eae3a-14ba-4666-9cf7-f308c121c650 service nova] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Received unexpected event network-vif-plugged-c0288dd3-2116-4c18-a4ca-73e0399ec75a for instance with vm_state deleted and task_state None.
Jul 25 16:02:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:02:30 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300935.243498, d1ecb257-072c-4d1c-b2c4-15486ae66936 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:02:30 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] VM Stopped (Lifecycle Event)
Jul 25 16:02:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b871576d-680d-4118-91cf-8848b15c602b None None] [instance: d1ecb257-072c-4d1c-b2c4-15486ae66936] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:02:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:02:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:45 user nova-compute[70869]: INFO nova.compute.manager [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Terminating instance
Jul 25 16:02:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-9f362a7d-7578-43e0-9af3-3039c4838e0e req-655107ab-b85d-4244-8692-fad178d42421 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received event network-vif-unplugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9f362a7d-7578-43e0-9af3-3039c4838e0e req-655107ab-b85d-4244-8692-fad178d42421 service nova] Acquiring lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9f362a7d-7578-43e0-9af3-3039c4838e0e req-655107ab-b85d-4244-8692-fad178d42421 service nova] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9f362a7d-7578-43e0-9af3-3039c4838e0e req-655107ab-b85d-4244-8692-fad178d42421 service nova] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-9f362a7d-7578-43e0-9af3-3039c4838e0e req-655107ab-b85d-4244-8692-fad178d42421 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] No waiting events found dispatching network-vif-unplugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:02:45 user nova-compute[70869]: DEBUG nova.compute.manager [req-9f362a7d-7578-43e0-9af3-3039c4838e0e req-655107ab-b85d-4244-8692-fad178d42421 service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received event network-vif-unplugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:02:46 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Instance destroyed successfully.
Jul 25 16:02:46 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'resources' on Instance uuid a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1782369048',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1782369048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1782369048',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFrTMnqYzDpEuWOuJdm17DzcmrI2QG8Dl1cArokkmeww9RqsPCf5kzM+q9sh6MJwkWGrzUQJc6w60R44VGJo09JfT6mkgmHQ2dkjXHpSasifkz/KmCeMX7t39GCJSeSgg==',key_name='tempest-keypair-168928722',keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-dsjd9ggg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "address": "fa:16:3e:8d:a2:9d", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac12f13f-9c", "ovs_interfaceid": "ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a2:9d,bridge_name='br-int',has_traffic_filtering=True,id=ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac12f13f-9c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_vif [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a2:9d,bridge_name='br-int',has_traffic_filtering=True,id=ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac12f13f-9c') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac12f13f-9c, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:02:46 user nova-compute[70869]: INFO os_vif [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a2:9d,bridge_name='br-int',has_traffic_filtering=True,id=ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac12f13f-9c')
Jul 25 16:02:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NioLGMDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:02:46 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b95dc0-7474-4757-bcb5-010c50e6ec3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:02:46 user nova-compute[70869]: No targets found.
Jul 25 16:02:46 user nova-compute[70869]: iSNS:
Jul 25 16:02:46 user nova-compute[70869]: No targets found.
Jul 25 16:02:46 user nova-compute[70869]: STATIC:
Jul 25 16:02:46 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e
Jul 25 16:02:46 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:02:46 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:02:46 user nova-compute[70869]: FIRMWARE:
Jul 25 16:02:46 user nova-compute[70869]: No targets found.
Jul 25 16:02:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:02:46 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:02:46 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[23735caa-637c-4671-80d2-5319cb13dc66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d7555-1427-420d-8248-6e4a32846445]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:02:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e (non-flash)
Jul 25 16:02:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe434168d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3489a25-34d7-48bf-9646-577b5b6589a7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[92865ec5-fe11-4a50-afb3-c58e09a9567e]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd8651-d478-446c-a3d2-ea1e626ee581]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[743b7692-2069-4e41-9166-f0870daa29ef]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7b08c0c1-39fa3e0f5e6b2f52', '/dev/disk/by-id/scsi-23339666133653066', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7b08c0c1') {{(pid=82054) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad389a3-3a0f-4bf0-b2e4-acc5e90de721]: (4, None) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d656a6-d121-43da-af85-5e2a3f7a20a9]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1d51df-4fee-499e-a1db-7dd48d3c9a67]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e, portal: 172.16.0.220,3260]
Jul 25 16:02:46 user nova-compute[70869]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e, portal: 172.16.0.220,3260] successful.
Jul 25 16:02:46 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f90b07b-6643-4acf-8e9b-2ce804c5bd8f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== disconnect_volume: return (285ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:02:46 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Deleting instance files /opt/stack/data/nova/instances/a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1_del
Jul 25 16:02:46 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Deletion of /opt/stack/data/nova/instances/a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1_del complete
Jul 25 16:02:46 user nova-compute[70869]: INFO nova.compute.manager [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 25 16:02:46 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:02:46 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:02:47 user nova-compute[70869]: INFO nova.compute.claims [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Claim successful on node user
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:02:47 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.policy [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41de05146fc5424a9f4b4852a3739135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bbd6a3baf146179b81bda84bdd466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:02:47 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Creating image(s)
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "/opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "/opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:47 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG nova.compute.manager [req-37c36214-946a-4616-a3f7-1ef6b13aa0b6 req-7161f1e4-eb95-45da-98e0-22e79613ca5c service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received event network-vif-plugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-37c36214-946a-4616-a3f7-1ef6b13aa0b6 req-7161f1e4-eb95-45da-98e0-22e79613ca5c service nova] Acquiring lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-37c36214-946a-4616-a3f7-1ef6b13aa0b6 req-7161f1e4-eb95-45da-98e0-22e79613ca5c service nova] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-37c36214-946a-4616-a3f7-1ef6b13aa0b6 req-7161f1e4-eb95-45da-98e0-22e79613ca5c service nova] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG nova.compute.manager [req-37c36214-946a-4616-a3f7-1ef6b13aa0b6 req-7161f1e4-eb95-45da-98e0-22e79613ca5c service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] No waiting events found dispatching network-vif-plugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:02:48 user nova-compute[70869]: WARNING nova.compute.manager [req-37c36214-946a-4616-a3f7-1ef6b13aa0b6 req-7161f1e4-eb95-45da-98e0-22e79613ca5c service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received unexpected event network-vif-plugged-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 for instance with vm_state active and task_state deleting.
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.153s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Took 1.62 seconds to deallocate network for instance.
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.160s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk 1073741824" returned: 0 in 0.047s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.174s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Successfully created port: ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Cannot resize image /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG nova.objects.instance [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'migration_context' on Instance uuid d0da2b6b-cf1e-4222-b68a-20485c9676dd {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Ensure instance console log exists: /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:02:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:02:49 user nova-compute[70869]: INFO nova.compute.manager [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Took 0.99 seconds to detach 1 volumes for instance.
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Deleting volume: 4f6999f4-ebc5-4ad6-94d8-f6ac4b225d6e {{(pid=70869) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 25 16:02:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:02:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8676MB free_disk=25.33498764038086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d0da2b6b-cf1e-4222-b68a-20485c9676dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Successfully updated port: ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquired lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-9bff70d4-0efc-4559-8e89-5865acc63244 req-7ba62f33-827b-4e87-ab8a-87bebab9efdf service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received event network-changed-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.manager [req-9bff70d4-0efc-4559-8e89-5865acc63244 req-7ba62f33-827b-4e87-ab8a-87bebab9efdf service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Refreshing instance network info cache due to event network-changed-ec493035-93a3-4abd-bf09-60d845da9b22. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9bff70d4-0efc-4559-8e89-5865acc63244 req-7ba62f33-827b-4e87-ab8a-87bebab9efdf service nova] Acquiring lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.166s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:49 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Deleted allocations for instance a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.network.neutron [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updating instance_info_cache with network_info: [{"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Releasing lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Instance network_info: |[{"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9bff70d4-0efc-4559-8e89-5865acc63244 req-7ba62f33-827b-4e87-ab8a-87bebab9efdf service nova] Acquired lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.network.neutron [req-9bff70d4-0efc-4559-8e89-5865acc63244 req-7ba62f33-827b-4e87-ab8a-87bebab9efdf service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Refreshing network info cache for port ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Start _get_guest_xml network_info=[{"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f1a82fe2-58e9-41fe-8174-21167b1b8d91 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.331s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:02:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:02:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1185004703',display_name='tempest-AttachVolumeNegativeTest-server-1185004703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1185004703',id=47,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfuwpBgE409UkWXktnQNvWpZZ9+v8aHPtE5BJyBTyuxud6FmMP2gBC8jDyH0fJspQcxpTC78Db+3yhgDNtHexOYQVRNzI0oZAVJheVGuL6DTBjki6tks0MyRRDJKpwfkg==',key_name='tempest-keypair-2125829625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-qzrdgysz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=d0da2b6b-cf1e-4222-b68a-20485c9676dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:8b,bridge_name='br-int',has_traffic_filtering=True,id=ec493035-93a3-4abd-bf09-60d845da9b22,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec493035-93') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.objects.instance [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'pci_devices' on Instance uuid d0da2b6b-cf1e-4222-b68a-20485c9676dd {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:02:49 user nova-compute[70869]:   <uuid>d0da2b6b-cf1e-4222-b68a-20485c9676dd</uuid>
Jul 25 16:02:49 user nova-compute[70869]:   <name>instance-0000002f</name>
Jul 25 16:02:49 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 16:02:49 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 16:02:49 user nova-compute[70869]:   <metadata>
Jul 25 16:02:49 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:02:49 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 16:02:49 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1185004703</nova:name>
Jul 25 16:02:49 user nova-compute[70869]:       <nova:creationTime>2023-07-25 16:02:49</nova:creationTime>
Jul 25 16:02:49 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 16:02:49 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 16:02:49 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 16:02:49 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 16:02:49 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:02:49 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:02:49 user nova-compute[70869]:       </nova:flavor>
Jul 25 16:02:49 user nova-compute[70869]:       <nova:owner>
Jul 25 16:02:49 user nova-compute[70869]:         <nova:user uuid="41de05146fc5424a9f4b4852a3739135">tempest-AttachVolumeNegativeTest-1624272753-project-member</nova:user>
Jul 25 16:02:49 user nova-compute[70869]:         <nova:project uuid="82bbd6a3baf146179b81bda84bdd466a">tempest-AttachVolumeNegativeTest-1624272753</nova:project>
Jul 25 16:02:49 user nova-compute[70869]:       </nova:owner>
Jul 25 16:02:49 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 16:02:49 user nova-compute[70869]:       <nova:ports>
Jul 25 16:02:49 user nova-compute[70869]:         <nova:port uuid="ec493035-93a3-4abd-bf09-60d845da9b22">
Jul 25 16:02:49 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:02:49 user nova-compute[70869]:         </nova:port>
Jul 25 16:02:49 user nova-compute[70869]:       </nova:ports>
Jul 25 16:02:49 user nova-compute[70869]:     </nova:instance>
Jul 25 16:02:49 user nova-compute[70869]:   </metadata>
Jul 25 16:02:49 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 16:02:49 user nova-compute[70869]:     <system>
Jul 25 16:02:49 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:02:49 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:02:49 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 16:02:49 user nova-compute[70869]:       <entry name="serial">d0da2b6b-cf1e-4222-b68a-20485c9676dd</entry>
Jul 25 16:02:49 user nova-compute[70869]:       <entry name="uuid">d0da2b6b-cf1e-4222-b68a-20485c9676dd</entry>
Jul 25 16:02:49 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:02:49 user nova-compute[70869]:     </system>
Jul 25 16:02:49 user nova-compute[70869]:   </sysinfo>
Jul 25 16:02:49 user nova-compute[70869]:   <os>
Jul 25 16:02:49 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:02:49 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 16:02:49 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 16:02:49 user nova-compute[70869]:   </os>
Jul 25 16:02:49 user nova-compute[70869]:   <features>
Jul 25 16:02:49 user nova-compute[70869]:     <acpi/>
Jul 25 16:02:49 user nova-compute[70869]:     <apic/>
Jul 25 16:02:49 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 16:02:49 user nova-compute[70869]:   </features>
Jul 25 16:02:49 user nova-compute[70869]:   <clock offset="utc">
Jul 25 16:02:49 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:02:49 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:02:49 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 16:02:49 user nova-compute[70869]:   </clock>
Jul 25 16:02:49 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 16:02:49 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 16:02:49 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:02:49 user nova-compute[70869]:   </cpu>
Jul 25 16:02:49 user nova-compute[70869]:   <devices>
Jul 25 16:02:49 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 16:02:49 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:02:49 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk"/>
Jul 25 16:02:49 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 16:02:49 user nova-compute[70869]:     </disk>
Jul 25 16:02:49 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 16:02:49 user nova-compute[70869]:       <mac address="fa:16:3e:29:c5:8b"/>
Jul 25 16:02:49 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:02:49 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 16:02:49 user nova-compute[70869]:       <target dev="tapec493035-93"/>
Jul 25 16:02:49 user nova-compute[70869]:     </interface>
Jul 25 16:02:49 user nova-compute[70869]:     <serial type="pty">
Jul 25 16:02:49 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/console.log" append="off"/>
Jul 25 16:02:49 user nova-compute[70869]:     </serial>
Jul 25 16:02:49 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:02:49 user nova-compute[70869]:     <video>
Jul 25 16:02:49 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:02:49 user nova-compute[70869]:     </video>
Jul 25 16:02:49 user nova-compute[70869]:     <rng model="virtio">
Jul 25 16:02:49 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:02:49 user nova-compute[70869]:     </rng>
Jul 25 16:02:49 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:02:49 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 16:02:49 user nova-compute[70869]:       <stats period="10"/>
Jul 25 16:02:49 user nova-compute[70869]:     </memballoon>
Jul 25 16:02:49 user nova-compute[70869]:   </devices>
Jul 25 16:02:49 user nova-compute[70869]: </domain>
Jul 25 16:02:49 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:02:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1185004703',display_name='tempest-AttachVolumeNegativeTest-server-1185004703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1185004703',id=47,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfuwpBgE409UkWXktnQNvWpZZ9+v8aHPtE5BJyBTyuxud6FmMP2gBC8jDyH0fJspQcxpTC78Db+3yhgDNtHexOYQVRNzI0oZAVJheVGuL6DTBjki6tks0MyRRDJKpwfkg==',key_name='tempest-keypair-2125829625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-qzrdgysz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=d0da2b6b-cf1e-4222-b68a-20485c9676dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:8b,bridge_name='br-int',has_traffic_filtering=True,id=ec493035-93a3-4abd-bf09-60d845da9b22,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec493035-93') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG os_vif [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:8b,bridge_name='br-int',has_traffic_filtering=True,id=ec493035-93a3-4abd-bf09-60d845da9b22,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec493035-93') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec493035-93, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec493035-93, col_values=(('external_ids', {'iface-id': 'ec493035-93a3-4abd-bf09-60d845da9b22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:c5:8b', 'vm-uuid': 'd0da2b6b-cf1e-4222-b68a-20485c9676dd'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:02:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:49 user nova-compute[70869]: INFO os_vif [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:8b,bridge_name='br-int',has_traffic_filtering=True,id=ec493035-93a3-4abd-bf09-60d845da9b22,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec493035-93')
Jul 25 16:02:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:02:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No VIF found with MAC fa:16:3e:29:c5:8b, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:02:50 user nova-compute[70869]: DEBUG nova.compute.manager [req-0c8b5583-5391-43c0-b03d-3b117f8bcbae req-c930fb74-ae5a-4fbb-9461-faf461e86b0d service nova] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Received event network-vif-deleted-ac12f13f-9c00-4975-9c8e-8e9ddb7a1da6 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:02:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-9bff70d4-0efc-4559-8e89-5865acc63244 req-7ba62f33-827b-4e87-ab8a-87bebab9efdf service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updated VIF entry in instance network info cache for port ec493035-93a3-4abd-bf09-60d845da9b22. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:02:50 user nova-compute[70869]: DEBUG nova.network.neutron [req-9bff70d4-0efc-4559-8e89-5865acc63244 req-7ba62f33-827b-4e87-ab8a-87bebab9efdf service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updating instance_info_cache with network_info: [{"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:02:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9bff70d4-0efc-4559-8e89-5865acc63244 req-7ba62f33-827b-4e87-ab8a-87bebab9efdf service nova] Releasing lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-05e25c32-cd5e-4362-8781-a46f0dedb476 req-2444fd5b-e59c-49cc-bbca-f32afa7a3e8c service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received event network-vif-plugged-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-05e25c32-cd5e-4362-8781-a46f0dedb476 req-2444fd5b-e59c-49cc-bbca-f32afa7a3e8c service nova] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-05e25c32-cd5e-4362-8781-a46f0dedb476 req-2444fd5b-e59c-49cc-bbca-f32afa7a3e8c service nova] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-05e25c32-cd5e-4362-8781-a46f0dedb476 req-2444fd5b-e59c-49cc-bbca-f32afa7a3e8c service nova] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG nova.compute.manager [req-05e25c32-cd5e-4362-8781-a46f0dedb476 req-2444fd5b-e59c-49cc-bbca-f32afa7a3e8c service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] No waiting events found dispatching network-vif-plugged-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:02:51 user nova-compute[70869]: WARNING nova.compute.manager [req-05e25c32-cd5e-4362-8781-a46f0dedb476 req-2444fd5b-e59c-49cc-bbca-f32afa7a3e8c service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received unexpected event network-vif-plugged-ec493035-93a3-4abd-bf09-60d845da9b22 for instance with vm_state building and task_state spawning.
Jul 25 16:02:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300973.4845316, d0da2b6b-cf1e-4222-b68a-20485c9676dd => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:02:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] VM Resumed (Lifecycle Event)
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:02:53 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Instance spawned successfully.
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:02:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690300973.485549, d0da2b6b-cf1e-4222-b68a-20485c9676dd => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:02:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] VM Started (Lifecycle Event)
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:02:53 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-508d1866-5856-43b3-9df7-51271ee86ecd req-a31dd438-a0d6-45c9-bded-16bb9229e801 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received event network-vif-plugged-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-508d1866-5856-43b3-9df7-51271ee86ecd req-a31dd438-a0d6-45c9-bded-16bb9229e801 service nova] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-508d1866-5856-43b3-9df7-51271ee86ecd req-a31dd438-a0d6-45c9-bded-16bb9229e801 service nova] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-508d1866-5856-43b3-9df7-51271ee86ecd req-a31dd438-a0d6-45c9-bded-16bb9229e801 service nova] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.compute.manager [req-508d1866-5856-43b3-9df7-51271ee86ecd req-a31dd438-a0d6-45c9-bded-16bb9229e801 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] No waiting events found dispatching network-vif-plugged-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:02:53 user nova-compute[70869]: WARNING nova.compute.manager [req-508d1866-5856-43b3-9df7-51271ee86ecd req-a31dd438-a0d6-45c9-bded-16bb9229e801 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received unexpected event network-vif-plugged-ec493035-93a3-4abd-bf09-60d845da9b22 for instance with vm_state building and task_state spawning.
Jul 25 16:02:53 user nova-compute[70869]: INFO nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Took 5.65 seconds to spawn the instance on the hypervisor.
Jul 25 16:02:53 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:02:53 user nova-compute[70869]: INFO nova.compute.manager [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Took 6.29 seconds to build instance.
Jul 25 16:02:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c563627e-794f-482a-a356-00c5b755c4f4 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.382s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:02:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:02:55 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:55 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:55 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:55 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:02:55 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:55 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:02:55 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 16:02:57 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:58 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances with incomplete migration  {{(pid=70869) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 16:02:59 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:02:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:00 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:03:01 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300966.2543375, a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:03:01 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] VM Stopped (Lifecycle Event)
Jul 25 16:03:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-6eb4a18f-7e3b-48d1-bdfe-803a6cb88c3a None None] [instance: a60ae18a-cf94-4bf9-bddc-05ebf2f4b3f1] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:03:03 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:03:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:11 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:03:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 16:03:11 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] There are 0 instances to clean {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 16:03:13 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:03:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:14 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:14 user nova-compute[70869]: INFO nova.compute.manager [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Terminating instance
Jul 25 16:03:14 user nova-compute[70869]: DEBUG nova.compute.manager [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:03:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-eef697c2-eb82-462c-a89b-3849cd5ad8be req-64b08435-71a5-4a4c-8bef-08b16c6f67cb service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-unplugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-eef697c2-eb82-462c-a89b-3849cd5ad8be req-64b08435-71a5-4a4c-8bef-08b16c6f67cb service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-eef697c2-eb82-462c-a89b-3849cd5ad8be req-64b08435-71a5-4a4c-8bef-08b16c6f67cb service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-eef697c2-eb82-462c-a89b-3849cd5ad8be req-64b08435-71a5-4a4c-8bef-08b16c6f67cb service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-eef697c2-eb82-462c-a89b-3849cd5ad8be req-64b08435-71a5-4a4c-8bef-08b16c6f67cb service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-unplugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-eef697c2-eb82-462c-a89b-3849cd5ad8be req-64b08435-71a5-4a4c-8bef-08b16c6f67cb service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-unplugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:03:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Instance destroyed successfully.
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'resources' on Instance uuid a140f33e-19d2-41fa-9fbe-4b2791e2888c {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1014341533',display_name='tempest-ServerRescueNegativeTestJSON-server-1014341533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1014341533',id=32,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-g04b45ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:49:03Z,user_data=None,user_id='2cee3181b38f451a929907b0250f7ae0',uuid=a140f33e-19d2-41fa-9fbe-4b2791e2888c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "address": "fa:16:3e:c3:ca:36", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5a47b5-1a", "ovs_interfaceid": "2f5a47b5-1a92-478f-9edc-c07fccc05ed2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ca:36,bridge_name='br-int',has_traffic_filtering=True,id=2f5a47b5-1a92-478f-9edc-c07fccc05ed2,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5a47b5-1a') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG os_vif [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ca:36,bridge_name='br-int',has_traffic_filtering=True,id=2f5a47b5-1a92-478f-9edc-c07fccc05ed2,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5a47b5-1a') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f5a47b5-1a, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:03:15 user nova-compute[70869]: INFO os_vif [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ca:36,bridge_name='br-int',has_traffic_filtering=True,id=2f5a47b5-1a92-478f-9edc-c07fccc05ed2,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5a47b5-1a')
Jul 25 16:03:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Deleting instance files /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c_del
Jul 25 16:03:15 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Deletion of /opt/stack/data/nova/instances/a140f33e-19d2-41fa-9fbe-4b2791e2888c_del complete
Jul 25 16:03:15 user nova-compute[70869]: INFO nova.compute.manager [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Took 0.72 seconds to destroy the instance on the hypervisor.
Jul 25 16:03:15 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:03:15 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Took 0.56 seconds to deallocate network for instance.
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-a3cfdf09-b53e-4533-bd50-6a93c652f682 req-83de1c19-331b-4f03-9959-f856a0311032 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-deleted-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:03:15 user nova-compute[70869]: INFO nova.compute.manager [req-a3cfdf09-b53e-4533-bd50-6a93c652f682 req-83de1c19-331b-4f03-9959-f856a0311032 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Neutron deleted interface 2f5a47b5-1a92-478f-9edc-c07fccc05ed2; detaching it from the instance and deleting it from the info cache
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.network.neutron [req-a3cfdf09-b53e-4533-bd50-6a93c652f682 req-83de1c19-331b-4f03-9959-f856a0311032 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:03:15 user nova-compute[70869]: DEBUG nova.compute.manager [req-a3cfdf09-b53e-4533-bd50-6a93c652f682 req-83de1c19-331b-4f03-9959-f856a0311032 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Detach interface failed, port_id=2f5a47b5-1a92-478f-9edc-c07fccc05ed2, reason: Instance a140f33e-19d2-41fa-9fbe-4b2791e2888c could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Refreshing inventories for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Updating ProviderTree inventory for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Refreshing aggregate associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, aggregates: None {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Refreshing trait associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41 {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:03:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:16 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Deleted allocations for instance a140f33e-19d2-41fa-9fbe-4b2791e2888c
Jul 25 16:03:16 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3b9da9e4-10cd-48d7-ab93-ce275afa9f4b tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.841s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-7aab9985-9697-4516-b1e6-9df9af9f27e1 req-e90314c5-f89c-45fe-aead-e1ba9258a179 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:03:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7aab9985-9697-4516-b1e6-9df9af9f27e1 req-e90314c5-f89c-45fe-aead-e1ba9258a179 service nova] Acquiring lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7aab9985-9697-4516-b1e6-9df9af9f27e1 req-e90314c5-f89c-45fe-aead-e1ba9258a179 service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:17 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7aab9985-9697-4516-b1e6-9df9af9f27e1 req-e90314c5-f89c-45fe-aead-e1ba9258a179 service nova] Lock "a140f33e-19d2-41fa-9fbe-4b2791e2888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:17 user nova-compute[70869]: DEBUG nova.compute.manager [req-7aab9985-9697-4516-b1e6-9df9af9f27e1 req-e90314c5-f89c-45fe-aead-e1ba9258a179 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] No waiting events found dispatching network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:03:17 user nova-compute[70869]: WARNING nova.compute.manager [req-7aab9985-9697-4516-b1e6-9df9af9f27e1 req-e90314c5-f89c-45fe-aead-e1ba9258a179 service nova] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Received unexpected event network-vif-plugged-2f5a47b5-1a92-478f-9edc-c07fccc05ed2 for instance with vm_state deleted and task_state None.
Jul 25 16:03:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:20 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:25 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:30 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690300995.2465558, a140f33e-19d2-41fa-9fbe-4b2791e2888c => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:03:30 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] VM Stopped (Lifecycle Event)
Jul 25 16:03:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-f69d6301-50e7-4409-a815-e0c52388b9aa None None] [instance: a140f33e-19d2-41fa-9fbe-4b2791e2888c] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:03:30 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:35 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:03:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:40 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:45 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:03:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:45 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:03:45 user nova-compute[70869]: INFO nova.compute.claims [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Claim successful on node user
Jul 25 16:03:45 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:03:45 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:03:46 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:03:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:03:46 user nova-compute[70869]: INFO nova.virt.block_device [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Booting with volume 6b72fca0-7d33-4213-b3f2-0583794eccf1 at /dev/vda
Jul 25 16:03:46 user nova-compute[70869]: DEBUG nova.policy [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f175a95c6c4e43b4b7d1910419070bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d4fe99fc224a2686f2f3daf32ecbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG os_brick.utils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bafa09e-d772-4a9c-b777-e1d30aed3d85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c18c6c-e077-4c17-b474-bd7ca54c94ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a35685c-a647-4d1e-8604-fd420f2618d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbb20be-8326-40ba-8ed0-d3deac048c5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:03:46 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:03:46 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6345166-b8ef-4247-8e0e-84f864377fb1]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG os_brick.utils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Updating existing volume attachment record: 30ee00c5-bfe5-4ddd-a704-cce756e7006d {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:03:46 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Successfully created port: 9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Successfully updated port: 9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "refresh_cache-9b6561bc-a578-490b-b2f8-8ffa8e758ac8" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquired lock "refresh_cache-9b6561bc-a578-490b-b2f8-8ffa8e758ac8" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-8232e168-72cf-4a37-8602-ec06b98cc453 req-0078e035-affe-4a97-a1d9-ca950356da52 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received event network-changed-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG nova.compute.manager [req-8232e168-72cf-4a37-8602-ec06b98cc453 req-0078e035-affe-4a97-a1d9-ca950356da52 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Refreshing instance network info cache due to event network-changed-9e1a0a5e-9236-435f-8e93-6397fceb41f0. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8232e168-72cf-4a37-8602-ec06b98cc453 req-0078e035-affe-4a97-a1d9-ca950356da52 service nova] Acquiring lock "refresh_cache-9b6561bc-a578-490b-b2f8-8ffa8e758ac8" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG nova.network.neutron [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Updating instance_info_cache with network_info: [{"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Releasing lock "refresh_cache-9b6561bc-a578-490b-b2f8-8ffa8e758ac8" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Instance network_info: |[{"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8232e168-72cf-4a37-8602-ec06b98cc453 req-0078e035-affe-4a97-a1d9-ca950356da52 service nova] Acquired lock "refresh_cache-9b6561bc-a578-490b-b2f8-8ffa8e758ac8" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:03:47 user nova-compute[70869]: DEBUG nova.network.neutron [req-8232e168-72cf-4a37-8602-ec06b98cc453 req-0078e035-affe-4a97-a1d9-ca950356da52 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Refreshing network info cache for port 9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:03:48 user nova-compute[70869]: DEBUG nova.network.neutron [req-8232e168-72cf-4a37-8602-ec06b98cc453 req-0078e035-affe-4a97-a1d9-ca950356da52 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Updated VIF entry in instance network info cache for port 9e1a0a5e-9236-435f-8e93-6397fceb41f0. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:03:48 user nova-compute[70869]: DEBUG nova.network.neutron [req-8232e168-72cf-4a37-8602-ec06b98cc453 req-0078e035-affe-4a97-a1d9-ca950356da52 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Updating instance_info_cache with network_info: [{"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:03:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8232e168-72cf-4a37-8602-ec06b98cc453 req-0078e035-affe-4a97-a1d9-ca950356da52 service nova] Releasing lock "refresh_cache-9b6561bc-a578-490b-b2f8-8ffa8e758ac8" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:03:48 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:03:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:48 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:48 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:03:48 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:03:49 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:03:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.32476043701172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance e1ff49de-2dee-476c-8bf1-b70e64fe991e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d0da2b6b-cf1e-4222-b68a-20485c9676dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 9b6561bc-a578-490b-b2f8-8ffa8e758ac8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:03:49 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:03:50 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:03:50 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:03:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:03:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:50 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:03:56 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Creating image(s)
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Ensure instance console log exists: /opt/stack/data/nova/instances/9b6561bc-a578-490b-b2f8-8ffa8e758ac8/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Start _get_guest_xml network_info=[{"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '30ee00c5-bfe5-4ddd-a704-cce756e7006d', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdWzmLMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b6561bc-a578-490b-b2f8-8ffa8e758ac8', 'attached_at': '', 'detached_at': '', 'volume_id': '6b72fca0-7d33-4213-b3f2-0583794eccf1', 'serial': '6b72fca0-7d33-4213-b3f2-0583794eccf1'}, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:03:56 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:03:56 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdWzmLMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:03:56 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:03:56 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:03:56 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebf1743-1a17-49e5-903b-480d3e8c28be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:03:56 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7378281d-a60e-4b20-bb0f-7f5bb529062a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1] added
Jul 25 16:03:56 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[02763eb6-4af1-42fa-b2d7-0f00b0fc2a29]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf60076-4656-4bc7-92bd-c04e56a3ac2c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdWzmLMH {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdWzmLMH" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[328a9b6f-3da0-42a6-a872-c8f388d96ba0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RdWzmLMH'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f1d8f8-940b-4b84-9df4-7377c381e08b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2403e7b-6cff-4ff0-a43e-f77d315f0bff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:03:56 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:03:56 user nova-compute[70869]:  {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:03:56 user nova-compute[70869]: WARNING os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 16:03:56 user nova-compute[70869]: 
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfd7231-eb80-4452-b702-70e6d80d733d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260]
Jul 25 16:03:56 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260] successful.
Jul 25 16:03:56 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a732a1cf-117c-41e2-99d2-e36ccae84a5f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d452c-9a3d-47a5-8313-fdcd25c6b449]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:03:56 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:03:56 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1404c395-8b6b-4699-8f5f-7b6d205e77c2]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdWzmLMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:03:56 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23234653537363039', 'path': '/dev/sdb'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234653537363039', 'path': '/dev/sdb'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2041616275',display_name='tempest-TestVolumeBootPattern-server-2041616275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2041616275',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqjb/4INnE5Q7haEGBoiJ2p8MTmRd3cHvxRoqpkDS9ZbSbKgpJ0XXSjxTNNldbDFAEx8QJ4zDRTocfDJ/QShLCT2MbOT51gi80w4AHoAQQEx2d5MZTCofThyZZ/3b0Hig==',key_name='tempest-TestVolumeBootPattern-1263460613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-mxbwn3ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:03:46Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=9b6561bc-a578-490b-b2f8-8ffa8e758ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:58:77,bridge_name='br-int',has_traffic_filtering=True,id=9e1a0a5e-9236-435f-8e93-6397fceb41f0,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1a0a5e-92') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.objects.instance [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b6561bc-a578-490b-b2f8-8ffa8e758ac8 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:03:57 user nova-compute[70869]:   <uuid>9b6561bc-a578-490b-b2f8-8ffa8e758ac8</uuid>
Jul 25 16:03:57 user nova-compute[70869]:   <name>instance-00000030</name>
Jul 25 16:03:57 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 16:03:57 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 16:03:57 user nova-compute[70869]:   <metadata>
Jul 25 16:03:57 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:03:57 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 16:03:57 user nova-compute[70869]:       <nova:name>tempest-TestVolumeBootPattern-server-2041616275</nova:name>
Jul 25 16:03:57 user nova-compute[70869]:       <nova:creationTime>2023-07-25 16:03:56</nova:creationTime>
Jul 25 16:03:57 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 16:03:57 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 16:03:57 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 16:03:57 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 16:03:57 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:03:57 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:03:57 user nova-compute[70869]:       </nova:flavor>
Jul 25 16:03:57 user nova-compute[70869]:       <nova:owner>
Jul 25 16:03:57 user nova-compute[70869]:         <nova:user uuid="f175a95c6c4e43b4b7d1910419070bf7">tempest-TestVolumeBootPattern-1492727042-project-member</nova:user>
Jul 25 16:03:57 user nova-compute[70869]:         <nova:project uuid="a0d4fe99fc224a2686f2f3daf32ecbd5">tempest-TestVolumeBootPattern-1492727042</nova:project>
Jul 25 16:03:57 user nova-compute[70869]:       </nova:owner>
Jul 25 16:03:57 user nova-compute[70869]:       <nova:ports>
Jul 25 16:03:57 user nova-compute[70869]:         <nova:port uuid="9e1a0a5e-9236-435f-8e93-6397fceb41f0">
Jul 25 16:03:57 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 25 16:03:57 user nova-compute[70869]:         </nova:port>
Jul 25 16:03:57 user nova-compute[70869]:       </nova:ports>
Jul 25 16:03:57 user nova-compute[70869]:     </nova:instance>
Jul 25 16:03:57 user nova-compute[70869]:   </metadata>
Jul 25 16:03:57 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 16:03:57 user nova-compute[70869]:     <system>
Jul 25 16:03:57 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:03:57 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:03:57 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 16:03:57 user nova-compute[70869]:       <entry name="serial">9b6561bc-a578-490b-b2f8-8ffa8e758ac8</entry>
Jul 25 16:03:57 user nova-compute[70869]:       <entry name="uuid">9b6561bc-a578-490b-b2f8-8ffa8e758ac8</entry>
Jul 25 16:03:57 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:03:57 user nova-compute[70869]:     </system>
Jul 25 16:03:57 user nova-compute[70869]:   </sysinfo>
Jul 25 16:03:57 user nova-compute[70869]:   <os>
Jul 25 16:03:57 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:03:57 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 16:03:57 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 16:03:57 user nova-compute[70869]:   </os>
Jul 25 16:03:57 user nova-compute[70869]:   <features>
Jul 25 16:03:57 user nova-compute[70869]:     <acpi/>
Jul 25 16:03:57 user nova-compute[70869]:     <apic/>
Jul 25 16:03:57 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 16:03:57 user nova-compute[70869]:   </features>
Jul 25 16:03:57 user nova-compute[70869]:   <clock offset="utc">
Jul 25 16:03:57 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:03:57 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:03:57 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 16:03:57 user nova-compute[70869]:   </clock>
Jul 25 16:03:57 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 16:03:57 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 16:03:57 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:03:57 user nova-compute[70869]:   </cpu>
Jul 25 16:03:57 user nova-compute[70869]:   <devices>
Jul 25 16:03:57 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 16:03:57 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:03:57 user nova-compute[70869]:       <source dev="/dev/sdb"/>
Jul 25 16:03:57 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 16:03:57 user nova-compute[70869]:       <serial>6b72fca0-7d33-4213-b3f2-0583794eccf1</serial>
Jul 25 16:03:57 user nova-compute[70869]:     </disk>
Jul 25 16:03:57 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 16:03:57 user nova-compute[70869]:       <mac address="fa:16:3e:16:58:77"/>
Jul 25 16:03:57 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:03:57 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 16:03:57 user nova-compute[70869]:       <target dev="tap9e1a0a5e-92"/>
Jul 25 16:03:57 user nova-compute[70869]:     </interface>
Jul 25 16:03:57 user nova-compute[70869]:     <serial type="pty">
Jul 25 16:03:57 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/9b6561bc-a578-490b-b2f8-8ffa8e758ac8/console.log" append="off"/>
Jul 25 16:03:57 user nova-compute[70869]:     </serial>
Jul 25 16:03:57 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:03:57 user nova-compute[70869]:     <video>
Jul 25 16:03:57 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:03:57 user nova-compute[70869]:     </video>
Jul 25 16:03:57 user nova-compute[70869]:     <rng model="virtio">
Jul 25 16:03:57 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:03:57 user nova-compute[70869]:     </rng>
Jul 25 16:03:57 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:03:57 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 16:03:57 user nova-compute[70869]:       <stats period="10"/>
Jul 25 16:03:57 user nova-compute[70869]:     </memballoon>
Jul 25 16:03:57 user nova-compute[70869]:   </devices>
Jul 25 16:03:57 user nova-compute[70869]: </domain>
Jul 25 16:03:57 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2041616275',display_name='tempest-TestVolumeBootPattern-server-2041616275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2041616275',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqjb/4INnE5Q7haEGBoiJ2p8MTmRd3cHvxRoqpkDS9ZbSbKgpJ0XXSjxTNNldbDFAEx8QJ4zDRTocfDJ/QShLCT2MbOT51gi80w4AHoAQQEx2d5MZTCofThyZZ/3b0Hig==',key_name='tempest-TestVolumeBootPattern-1263460613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-mxbwn3ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:03:46Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=9b6561bc-a578-490b-b2f8-8ffa8e758ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:58:77,bridge_name='br-int',has_traffic_filtering=True,id=9e1a0a5e-9236-435f-8e93-6397fceb41f0,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1a0a5e-92') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG os_vif [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:58:77,bridge_name='br-int',has_traffic_filtering=True,id=9e1a0a5e-9236-435f-8e93-6397fceb41f0,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1a0a5e-92') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e1a0a5e-92, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e1a0a5e-92, col_values=(('external_ids', {'iface-id': '9e1a0a5e-9236-435f-8e93-6397fceb41f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:58:77', 'vm-uuid': '9b6561bc-a578-490b-b2f8-8ffa8e758ac8'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:57 user nova-compute[70869]: INFO os_vif [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:58:77,bridge_name='br-int',has_traffic_filtering=True,id=9e1a0a5e-9236-435f-8e93-6397fceb41f0,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1a0a5e-92')
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No VIF found with MAC fa:16:3e:16:58:77, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Skipping network cache update for instance because it is Building. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:03:57 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:03:58 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updating instance_info_cache with network_info: [{"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:03:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-e1ff49de-2dee-476c-8bf1-b70e64fe991e" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:03:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:03:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-52ff23a9-a12d-47f8-8d12-b55ce60e3f0f req-4ffd3022-0f5d-4003-995a-c064f449fe94 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received event network-vif-plugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:03:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-52ff23a9-a12d-47f8-8d12-b55ce60e3f0f req-4ffd3022-0f5d-4003-995a-c064f449fe94 service nova] Acquiring lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:03:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-52ff23a9-a12d-47f8-8d12-b55ce60e3f0f req-4ffd3022-0f5d-4003-995a-c064f449fe94 service nova] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:03:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-52ff23a9-a12d-47f8-8d12-b55ce60e3f0f req-4ffd3022-0f5d-4003-995a-c064f449fe94 service nova] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:03:59 user nova-compute[70869]: DEBUG nova.compute.manager [req-52ff23a9-a12d-47f8-8d12-b55ce60e3f0f req-4ffd3022-0f5d-4003-995a-c064f449fe94 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] No waiting events found dispatching network-vif-plugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:03:59 user nova-compute[70869]: WARNING nova.compute.manager [req-52ff23a9-a12d-47f8-8d12-b55ce60e3f0f req-4ffd3022-0f5d-4003-995a-c064f449fe94 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received unexpected event network-vif-plugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 for instance with vm_state building and task_state spawning.
Jul 25 16:03:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:03:59 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690301040.964145, 9b6561bc-a578-490b-b2f8-8ffa8e758ac8 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:04:00 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] VM Resumed (Lifecycle Event)
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:04:00 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Instance spawned successfully.
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:04:00 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:04:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:04:01 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:04:01 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:04:01 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690301040.9674187, 9b6561bc-a578-490b-b2f8-8ffa8e758ac8 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:04:01 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] VM Started (Lifecycle Event)
Jul 25 16:04:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:04:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:04:01 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:04:01 user nova-compute[70869]: INFO nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Took 4.92 seconds to spawn the instance on the hypervisor.
Jul 25 16:04:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:04:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-20b3fa1c-3383-4568-bbd7-2445c9cb07f4 req-77134f52-930c-44e5-95a8-210e38687460 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received event network-vif-plugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:04:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-20b3fa1c-3383-4568-bbd7-2445c9cb07f4 req-77134f52-930c-44e5-95a8-210e38687460 service nova] Acquiring lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-20b3fa1c-3383-4568-bbd7-2445c9cb07f4 req-77134f52-930c-44e5-95a8-210e38687460 service nova] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-20b3fa1c-3383-4568-bbd7-2445c9cb07f4 req-77134f52-930c-44e5-95a8-210e38687460 service nova] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:01 user nova-compute[70869]: DEBUG nova.compute.manager [req-20b3fa1c-3383-4568-bbd7-2445c9cb07f4 req-77134f52-930c-44e5-95a8-210e38687460 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] No waiting events found dispatching network-vif-plugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:04:01 user nova-compute[70869]: WARNING nova.compute.manager [req-20b3fa1c-3383-4568-bbd7-2445c9cb07f4 req-77134f52-930c-44e5-95a8-210e38687460 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received unexpected event network-vif-plugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 for instance with vm_state building and task_state spawning.
Jul 25 16:04:01 user nova-compute[70869]: INFO nova.compute.manager [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Took 15.44 seconds to build instance.
Jul 25 16:04:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-a91927ce-633c-4081-9325-dbc8a7c01fa8 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.561s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:01 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:02 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:05 user nova-compute[70869]: INFO nova.compute.manager [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Terminating instance
Jul 25 16:04:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-89c32ae3-9194-4c59-9359-bb4d94012529 req-8f843300-74f2-4a4c-9b45-c24a456036a3 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-89c32ae3-9194-4c59-9359-bb4d94012529 req-8f843300-74f2-4a4c-9b45-c24a456036a3 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-89c32ae3-9194-4c59-9359-bb4d94012529 req-8f843300-74f2-4a4c-9b45-c24a456036a3 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-89c32ae3-9194-4c59-9359-bb4d94012529 req-8f843300-74f2-4a4c-9b45-c24a456036a3 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-89c32ae3-9194-4c59-9359-bb4d94012529 req-8f843300-74f2-4a4c-9b45-c24a456036a3 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG nova.compute.manager [req-89c32ae3-9194-4c59-9359-bb4d94012529 req-8f843300-74f2-4a4c-9b45-c24a456036a3 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-unplugged-efe49064-97de-4484-9655-e582f8eac530 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:04:05 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:06 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Instance destroyed successfully.
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.objects.instance [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lazy-loading 'resources' on Instance uuid e1ff49de-2dee-476c-8bf1-b70e64fe991e {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T15:47:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055914467',display_name='tempest-ServerRescueNegativeTestJSON-server-2055914467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055914467',id=31,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-25T15:51:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40a65674a8194f93a976d52353da0c39',ramdisk_id='',reservation_id='r-igielsyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2116380302',owner_user_name='tempest-ServerRescueNegativeTestJSON-2116380302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T15:53:49Z,user_data=None,user_id='2cee3181b38f451a929907b0250f7ae0',uuid=e1ff49de-2dee-476c-8bf1-b70e64fe991e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converting VIF {"id": "efe49064-97de-4484-9655-e582f8eac530", "address": "fa:16:3e:99:ff:ec", "network": {"id": "483fb5ed-a699-4f26-be1a-06d9547b8a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-392387087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40a65674a8194f93a976d52353da0c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe49064-97", "ovs_interfaceid": "efe49064-97de-4484-9655-e582f8eac530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:ff:ec,bridge_name='br-int',has_traffic_filtering=True,id=efe49064-97de-4484-9655-e582f8eac530,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe49064-97') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG os_vif [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ff:ec,bridge_name='br-int',has_traffic_filtering=True,id=efe49064-97de-4484-9655-e582f8eac530,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe49064-97') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefe49064-97, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:04:06 user nova-compute[70869]: INFO os_vif [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ff:ec,bridge_name='br-int',has_traffic_filtering=True,id=efe49064-97de-4484-9655-e582f8eac530,network=Network(483fb5ed-a699-4f26-be1a-06d9547b8a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe49064-97')
Jul 25 16:04:06 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Deleting instance files /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e_del
Jul 25 16:04:06 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Deletion of /opt/stack/data/nova/instances/e1ff49de-2dee-476c-8bf1-b70e64fe991e_del complete
Jul 25 16:04:06 user nova-compute[70869]: INFO nova.compute.manager [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 25 16:04:06 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:04:06 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Took 0.44 seconds to deallocate network for instance.
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.compute.manager [req-b5299bae-2e40-4a27-9865-1303e5048b8d req-d72a04b1-9db4-4376-bf8c-488095008747 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-deleted-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:04:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:07 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Deleted allocations for instance e1ff49de-2dee-476c-8bf1-b70e64fe991e
Jul 25 16:04:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-cd78da08-a56f-46b6-9189-e52acd896dd8 tempest-ServerRescueNegativeTestJSON-2116380302 tempest-ServerRescueNegativeTestJSON-2116380302-project-member] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.720s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-19ac8e91-833d-439b-96d5-721adabfb665 req-8eb34321-8460-4dc1-9644-d02071bff055 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:04:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-19ac8e91-833d-439b-96d5-721adabfb665 req-8eb34321-8460-4dc1-9644-d02071bff055 service nova] Acquiring lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-19ac8e91-833d-439b-96d5-721adabfb665 req-8eb34321-8460-4dc1-9644-d02071bff055 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:07 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-19ac8e91-833d-439b-96d5-721adabfb665 req-8eb34321-8460-4dc1-9644-d02071bff055 service nova] Lock "e1ff49de-2dee-476c-8bf1-b70e64fe991e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:07 user nova-compute[70869]: DEBUG nova.compute.manager [req-19ac8e91-833d-439b-96d5-721adabfb665 req-8eb34321-8460-4dc1-9644-d02071bff055 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] No waiting events found dispatching network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:04:07 user nova-compute[70869]: WARNING nova.compute.manager [req-19ac8e91-833d-439b-96d5-721adabfb665 req-8eb34321-8460-4dc1-9644-d02071bff055 service nova] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Received unexpected event network-vif-plugged-efe49064-97de-4484-9655-e582f8eac530 for instance with vm_state deleted and task_state None.
Jul 25 16:04:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:12 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:21 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690301046.1641865, e1ff49de-2dee-476c-8bf1-b70e64fe991e => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:04:21 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] VM Stopped (Lifecycle Event)
Jul 25 16:04:21 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ed767975-9fed-46ba-a8b5-c5fc9bf5c393 None None] [instance: e1ff49de-2dee-476c-8bf1-b70e64fe991e] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:04:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:04:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:04:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:04:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:04:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-b9859372-3baf-4325-afaf-7de920abd6c9 req-e0dfd975-f10d-4a54-bc54-f5cdd664c514 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received event network-changed-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:04:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-b9859372-3baf-4325-afaf-7de920abd6c9 req-e0dfd975-f10d-4a54-bc54-f5cdd664c514 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Refreshing instance network info cache due to event network-changed-ec493035-93a3-4abd-bf09-60d845da9b22. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:04:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b9859372-3baf-4325-afaf-7de920abd6c9 req-e0dfd975-f10d-4a54-bc54-f5cdd664c514 service nova] Acquiring lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:04:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b9859372-3baf-4325-afaf-7de920abd6c9 req-e0dfd975-f10d-4a54-bc54-f5cdd664c514 service nova] Acquired lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:04:38 user nova-compute[70869]: DEBUG nova.network.neutron [req-b9859372-3baf-4325-afaf-7de920abd6c9 req-e0dfd975-f10d-4a54-bc54-f5cdd664c514 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Refreshing network info cache for port ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:04:39 user nova-compute[70869]: DEBUG nova.network.neutron [req-b9859372-3baf-4325-afaf-7de920abd6c9 req-e0dfd975-f10d-4a54-bc54-f5cdd664c514 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updated VIF entry in instance network info cache for port ec493035-93a3-4abd-bf09-60d845da9b22. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:04:39 user nova-compute[70869]: DEBUG nova.network.neutron [req-b9859372-3baf-4325-afaf-7de920abd6c9 req-e0dfd975-f10d-4a54-bc54-f5cdd664c514 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updating instance_info_cache with network_info: [{"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:04:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b9859372-3baf-4325-afaf-7de920abd6c9 req-e0dfd975-f10d-4a54-bc54-f5cdd664c514 service nova] Releasing lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:04:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'flavor' on Instance uuid d0da2b6b-cf1e-4222-b68a-20485c9676dd {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:42 user nova-compute[70869]: INFO nova.compute.manager [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Attaching volume 9d04c657-5ab3-4b12-8b93-d069d14f7038 to /dev/vdb
Jul 25 16:04:42 user nova-compute[70869]: DEBUG os_brick.utils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7db3f86-0c24-453e-821f-2e13d8d7a77d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9014e83e-555a-43f3-af9b-ee4eba608a0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acc5b4a-66a0-4975-a9e6-e819a84a6bf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[af57f304-0cd5-46e1-b356-574ed547747e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:04:42 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:04:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cdcb1d-0081-48d8-a279-49745fb11de0]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG os_brick.utils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:04:42 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updating existing volume attachment record: b6f4dd11-fda0-4c5f-8bf4-39d877a459e3 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:04:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:46 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awGjsrRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:04:49 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:04:49 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:04:49 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[13665f95-bc41-4e7f-aaad-93a217a1b5ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:04:49 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[59840bc3-47e8-405a-abd4-b3994adf35af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038] added
Jul 25 16:04:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c37add8-662e-4606-b757-4bfc75e3613a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[494b4517-401b-4645-9b09-a1a42ea2ba7c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awGjsrRF {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awGjsrRF" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51f0b4-77a7-48ed-9c55-eef4dfb5f645]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awGjsrRF'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11f2b0e-de02-44d4-8b30-5181f92611dd]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[223a19ff-9710-40b4-8d42-0099c1b0d782]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:04:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:04:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ee295f-49b1-4ba0-9023-3e333ae4fde2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038, portal: 172.16.0.220,3260]
Jul 25 16:04:49 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038, portal: 172.16.0.220,3260] successful.
Jul 25 16:04:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf98f78-f17c-4031-afa1-fee03988d50e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf9cfbd-2ab9-4f6e-95bd-fd36e8046da5]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:04:49 user nova-compute[70869]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 (non-flash)
Jul 25 16:04:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:04:49 user nova-compute[70869]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 (non-flash)
Jul 25 16:04:49 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba48d78e-01f3-4e27-a3be-080f412db7ee]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:04:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awGjsrRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23032626639653638', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032626639653638', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'flavor' on Instance uuid d0da2b6b-cf1e-4222-b68a-20485c9676dd {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:04:50 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:04:50 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 16:04:50 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:04:50 user nova-compute[70869]:   <serial>9d04c657-5ab3-4b12-8b93-d069d14f7038</serial>
Jul 25 16:04:50 user nova-compute[70869]: </disk>
Jul 25 16:04:50 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No VIF found with MAC fa:16:3e:29:c5:8b, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:04:50 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5bca69a1-d758-408d-844b-a9571d91dd6f tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.455s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:04:51 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:04:51 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=25.351032257080078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:04:51 user nova-compute[70869]: INFO nova.compute.manager [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Detaching volume 9d04c657-5ab3-4b12-8b93-d069d14f7038
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance d0da2b6b-cf1e-4222-b68a-20485c9676dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 9b6561bc-a578-490b-b2f8-8ffa8e758ac8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:04:51 user nova-compute[70869]: INFO nova.virt.block_device [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Attempting to driver detach volume 9d04c657-5ab3-4b12-8b93-d069d14f7038 from mountpoint /dev/vdb
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Attempting to detach device vdb from instance d0da2b6b-cf1e-4222-b68a-20485c9676dd from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:04:51 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:04:51 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 16:04:51 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:04:51 user nova-compute[70869]:   <serial>9d04c657-5ab3-4b12-8b93-d069d14f7038</serial>
Jul 25 16:04:51 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:04:51 user nova-compute[70869]: </disk>
Jul 25 16:04:51 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:04:51 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully detached device vdb from instance d0da2b6b-cf1e-4222-b68a-20485c9676dd from the persistent domain config.
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0da2b6b-cf1e-4222-b68a-20485c9676dd from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:04:51 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:04:51 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 16:04:51 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:04:51 user nova-compute[70869]:   <serial>9d04c657-5ab3-4b12-8b93-d069d14f7038</serial>
Jul 25 16:04:51 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:04:51 user nova-compute[70869]: </disk>
Jul 25 16:04:51 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:04:51 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690301092.2662215, d0da2b6b-cf1e-4222-b68a-20485c9676dd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0da2b6b-cf1e-4222-b68a-20485c9676dd {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:04:52 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully detached device vdb from instance d0da2b6b-cf1e-4222-b68a-20485c9676dd from the live domain config.
Jul 25 16:04:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awGjsrRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:04:52 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a498d5ab-7a5c-4834-a8c9-fd0cdb892e19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:04:52 user nova-compute[70869]: No targets found.
Jul 25 16:04:52 user nova-compute[70869]: iSNS:
Jul 25 16:04:52 user nova-compute[70869]: No targets found.
Jul 25 16:04:52 user nova-compute[70869]: STATIC:
Jul 25 16:04:52 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038
Jul 25 16:04:52 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:04:52 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:04:52 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1
Jul 25 16:04:52 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:04:52 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:04:52 user nova-compute[70869]: FIRMWARE:
Jul 25 16:04:52 user nova-compute[70869]: No targets found.
Jul 25 16:04:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:04:52 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:04:52 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f150325-3f54-4557-884b-7131bb602811]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6523d9ff-70cc-4c63-b397-a1e26964208e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:04:52 user nova-compute[70869]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 (non-flash)
Jul 25 16:04:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:04:52 user nova-compute[70869]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 (non-flash)
Jul 25 16:04:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43da15b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33c089b-a4b5-4c0d-882e-77cd803f3822]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2174f3-f4bd-4230-8866-b6d09b7cc285]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b1788-097d-4201-995b-f675e425234b]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[804b3533-360a-43dc-ac24-a93b8d8172fe]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce56afb6-c357-42e2-bda2-8d88144e87dd]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9fb4f8-04e3-4bf5-aad3-b76886169962]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038, portal: 172.16.0.220,3260]
Jul 25 16:04:52 user nova-compute[70869]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038, portal: 172.16.0.220,3260] successful.
Jul 25 16:04:52 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04c657-5ab3-4b12-8b93-d069d14f7038 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d0972a-499e-41ee-8b57-ebb27420edb3]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] <== disconnect_volume: return (286ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:04:52 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:04:53 user nova-compute[70869]: DEBUG nova.objects.instance [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'flavor' on Instance uuid d0da2b6b-cf1e-4222-b68a-20485c9676dd {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:04:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-f9440b0c-85d6-4af0-8955-ac2c60e37c00 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.602s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:04:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:57 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:57 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:04:58 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:04:59 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:04:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:04:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:04:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:04:59 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:05:00 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updating instance_info_cache with network_info: [{"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:05:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-d0da2b6b-cf1e-4222-b68a-20485c9676dd" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:05:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:05:01 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:01 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:05:01 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:05:03 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:05:05 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:05:06 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:05:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:11 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:16 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:05:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:05:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:05:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:05:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:05:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:05:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:31 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:05:36 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-e051ae60-cd16-4a04-92b3-5000edab0d33 req-d57345a1-353a-4a51-a0de-f5d92e4c298d service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received event network-changed-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG nova.compute.manager [req-e051ae60-cd16-4a04-92b3-5000edab0d33 req-d57345a1-353a-4a51-a0de-f5d92e4c298d service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Refreshing instance network info cache due to event network-changed-9e1a0a5e-9236-435f-8e93-6397fceb41f0. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e051ae60-cd16-4a04-92b3-5000edab0d33 req-d57345a1-353a-4a51-a0de-f5d92e4c298d service nova] Acquiring lock "refresh_cache-9b6561bc-a578-490b-b2f8-8ffa8e758ac8" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e051ae60-cd16-4a04-92b3-5000edab0d33 req-d57345a1-353a-4a51-a0de-f5d92e4c298d service nova] Acquired lock "refresh_cache-9b6561bc-a578-490b-b2f8-8ffa8e758ac8" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG nova.network.neutron [req-e051ae60-cd16-4a04-92b3-5000edab0d33 req-d57345a1-353a-4a51-a0de-f5d92e4c298d service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Refreshing network info cache for port 9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:38 user nova-compute[70869]: INFO nova.compute.manager [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Terminating instance
Jul 25 16:05:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG nova.network.neutron [req-e051ae60-cd16-4a04-92b3-5000edab0d33 req-d57345a1-353a-4a51-a0de-f5d92e4c298d service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Updated VIF entry in instance network info cache for port 9e1a0a5e-9236-435f-8e93-6397fceb41f0. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG nova.network.neutron [req-e051ae60-cd16-4a04-92b3-5000edab0d33 req-d57345a1-353a-4a51-a0de-f5d92e4c298d service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Updating instance_info_cache with network_info: [{"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:05:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e051ae60-cd16-4a04-92b3-5000edab0d33 req-d57345a1-353a-4a51-a0de-f5d92e4c298d service nova] Releasing lock "refresh_cache-9b6561bc-a578-490b-b2f8-8ffa8e758ac8" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d980f5e-7eb0-4207-94ee-88d3bceccec0 req-f4e4d832-7892-452e-9680-c86cb4f92e08 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received event network-vif-unplugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d980f5e-7eb0-4207-94ee-88d3bceccec0 req-f4e4d832-7892-452e-9680-c86cb4f92e08 service nova] Acquiring lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d980f5e-7eb0-4207-94ee-88d3bceccec0 req-f4e4d832-7892-452e-9680-c86cb4f92e08 service nova] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0d980f5e-7eb0-4207-94ee-88d3bceccec0 req-f4e4d832-7892-452e-9680-c86cb4f92e08 service nova] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d980f5e-7eb0-4207-94ee-88d3bceccec0 req-f4e4d832-7892-452e-9680-c86cb4f92e08 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] No waiting events found dispatching network-vif-unplugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-0d980f5e-7eb0-4207-94ee-88d3bceccec0 req-f4e4d832-7892-452e-9680-c86cb4f92e08 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received event network-vif-unplugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:05:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Instance destroyed successfully.
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'resources' on Instance uuid 9b6561bc-a578-490b-b2f8-8ffa8e758ac8 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2041616275',display_name='tempest-TestVolumeBootPattern-server-2041616275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2041616275',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqjb/4INnE5Q7haEGBoiJ2p8MTmRd3cHvxRoqpkDS9ZbSbKgpJ0XXSjxTNNldbDFAEx8QJ4zDRTocfDJ/QShLCT2MbOT51gi80w4AHoAQQEx2d5MZTCofThyZZ/3b0Hig==',key_name='tempest-TestVolumeBootPattern-1263460613',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:04:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-mxbwn3ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:04:01Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=9b6561bc-a578-490b-b2f8-8ffa8e758ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "address": "fa:16:3e:16:58:77", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e1a0a5e-92", "ovs_interfaceid": "9e1a0a5e-9236-435f-8e93-6397fceb41f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:58:77,bridge_name='br-int',has_traffic_filtering=True,id=9e1a0a5e-9236-435f-8e93-6397fceb41f0,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1a0a5e-92') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_vif [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:58:77,bridge_name='br-int',has_traffic_filtering=True,id=9e1a0a5e-9236-435f-8e93-6397fceb41f0,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1a0a5e-92') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e1a0a5e-92, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:05:39 user nova-compute[70869]: INFO os_vif [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:58:77,bridge_name='br-int',has_traffic_filtering=True,id=9e1a0a5e-9236-435f-8e93-6397fceb41f0,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e1a0a5e-92')
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdWzmLMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:05:39 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef7fff-7a85-41fb-b388-1ef67f1c79ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:05:39 user nova-compute[70869]: No targets found.
Jul 25 16:05:39 user nova-compute[70869]: iSNS:
Jul 25 16:05:39 user nova-compute[70869]: No targets found.
Jul 25 16:05:39 user nova-compute[70869]: STATIC:
Jul 25 16:05:39 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1
Jul 25 16:05:39 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:05:39 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:05:39 user nova-compute[70869]: FIRMWARE:
Jul 25 16:05:39 user nova-compute[70869]: No targets found.
Jul 25 16:05:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:05:39 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:05:39 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff618c1-d22d-41dc-9dbf-d84d1ec8770c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6977ae7c-a943-43e8-b6e0-1a84c38a950e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:05:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:05:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c1457e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1'): ({'sdb'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Removing single pathed devices sdb {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0469c5b-6091-486f-a9d4-4ac4c651d1ef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d712b31-b1d3-4ddd-a02d-983d627e1266]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flushing IO for device /dev/sdb {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89a3b3f-2cc0-4375-b062-55a5fd88c19c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b358f499-c8bd-4342-be63-19c778c3e527]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39940d8-a7f8-4e11-9d23-f967a1252bec]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23606e4-afc5-4110-990a-63b7b868ac64]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260]
Jul 25 16:05:39 user nova-compute[70869]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260] successful.
Jul 25 16:05:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9855937-92dd-4073-9e02-32359485796c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== disconnect_volume: return (308ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:05:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Deleting instance files /opt/stack/data/nova/instances/9b6561bc-a578-490b-b2f8-8ffa8e758ac8_del
Jul 25 16:05:39 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Deletion of /opt/stack/data/nova/instances/9b6561bc-a578-490b-b2f8-8ffa8e758ac8_del complete
Jul 25 16:05:39 user nova-compute[70869]: INFO nova.compute.manager [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 25 16:05:39 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:05:39 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:05:40 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:05:40 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Took 1.01 seconds to deallocate network for instance.
Jul 25 16:05:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-b554d342-8c86-4123-b293-f3dae8bd1c01 req-cbfffbb3-cfbb-4cce-8cb8-b124655fdaf3 service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received event network-vif-deleted-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-8db8aae7-e99c-490e-8525-1ce767255fd5 req-6aa83089-b6af-4545-af4a-e304f07c436a service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received event network-vif-plugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8db8aae7-e99c-490e-8525-1ce767255fd5 req-6aa83089-b6af-4545-af4a-e304f07c436a service nova] Acquiring lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8db8aae7-e99c-490e-8525-1ce767255fd5 req-6aa83089-b6af-4545-af4a-e304f07c436a service nova] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-8db8aae7-e99c-490e-8525-1ce767255fd5 req-6aa83089-b6af-4545-af4a-e304f07c436a service nova] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG nova.compute.manager [req-8db8aae7-e99c-490e-8525-1ce767255fd5 req-6aa83089-b6af-4545-af4a-e304f07c436a service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] No waiting events found dispatching network-vif-plugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:05:41 user nova-compute[70869]: WARNING nova.compute.manager [req-8db8aae7-e99c-490e-8525-1ce767255fd5 req-6aa83089-b6af-4545-af4a-e304f07c436a service nova] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Received unexpected event network-vif-plugged-9e1a0a5e-9236-435f-8e93-6397fceb41f0 for instance with vm_state active and task_state deleting.
Jul 25 16:05:41 user nova-compute[70869]: INFO nova.compute.manager [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Took 0.72 seconds to detach 1 volumes for instance.
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:41 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Deleted allocations for instance 9b6561bc-a578-490b-b2f8-8ffa8e758ac8
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-3728ab0c-b0ec-41e7-a729-868b2a10cccb tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "9b6561bc-a578-490b-b2f8-8ffa8e758ac8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.234s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:41 user nova-compute[70869]: INFO nova.compute.manager [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Terminating instance
Jul 25 16:05:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Instance destroyed successfully.
Jul 25 16:05:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'resources' on Instance uuid d0da2b6b-cf1e-4222-b68a-20485c9676dd {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:02:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1185004703',display_name='tempest-AttachVolumeNegativeTest-server-1185004703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1185004703',id=47,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfuwpBgE409UkWXktnQNvWpZZ9+v8aHPtE5BJyBTyuxud6FmMP2gBC8jDyH0fJspQcxpTC78Db+3yhgDNtHexOYQVRNzI0oZAVJheVGuL6DTBjki6tks0MyRRDJKpwfkg==',key_name='tempest-keypair-2125829625',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:02:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-qzrdgysz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=d0da2b6b-cf1e-4222-b68a-20485c9676dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "ec493035-93a3-4abd-bf09-60d845da9b22", "address": "fa:16:3e:29:c5:8b", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec493035-93", "ovs_interfaceid": "ec493035-93a3-4abd-bf09-60d845da9b22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:c5:8b,bridge_name='br-int',has_traffic_filtering=True,id=ec493035-93a3-4abd-bf09-60d845da9b22,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec493035-93') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG os_vif [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:c5:8b,bridge_name='br-int',has_traffic_filtering=True,id=ec493035-93a3-4abd-bf09-60d845da9b22,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec493035-93') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec493035-93, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:42 user nova-compute[70869]: INFO os_vif [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:c5:8b,bridge_name='br-int',has_traffic_filtering=True,id=ec493035-93a3-4abd-bf09-60d845da9b22,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec493035-93')
Jul 25 16:05:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Deleting instance files /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd_del
Jul 25 16:05:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Deletion of /opt/stack/data/nova/instances/d0da2b6b-cf1e-4222-b68a-20485c9676dd_del complete
Jul 25 16:05:42 user nova-compute[70869]: INFO nova.compute.manager [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 25 16:05:42 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:05:42 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received event network-vif-unplugged-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] No waiting events found dispatching network-vif-unplugged-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received event network-vif-unplugged-ec493035-93a3-4abd-bf09-60d845da9b22 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received event network-vif-plugged-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] Acquiring lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] No waiting events found dispatching network-vif-plugged-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:05:43 user nova-compute[70869]: WARNING nova.compute.manager [req-6fc8e1b5-bbe0-49e8-be2f-1e7effe3089c req-4669eb66-5a34-4335-aaba-3a81ee962138 service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received unexpected event network-vif-plugged-ec493035-93a3-4abd-bf09-60d845da9b22 for instance with vm_state active and task_state deleting.
Jul 25 16:05:43 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-0357a74f-19e9-4e35-acce-1fb34e9d863a req-66a88004-1b38-45cc-85b7-41e8543f340d service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Received event network-vif-deleted-ec493035-93a3-4abd-bf09-60d845da9b22 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:05:43 user nova-compute[70869]: INFO nova.compute.manager [req-0357a74f-19e9-4e35-acce-1fb34e9d863a req-66a88004-1b38-45cc-85b7-41e8543f340d service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Neutron deleted interface ec493035-93a3-4abd-bf09-60d845da9b22; detaching it from the instance and deleting it from the info cache
Jul 25 16:05:43 user nova-compute[70869]: DEBUG nova.network.neutron [req-0357a74f-19e9-4e35-acce-1fb34e9d863a req-66a88004-1b38-45cc-85b7-41e8543f340d service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:05:43 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Took 0.88 seconds to deallocate network for instance.
Jul 25 16:05:43 user nova-compute[70869]: DEBUG nova.compute.manager [req-0357a74f-19e9-4e35-acce-1fb34e9d863a req-66a88004-1b38-45cc-85b7-41e8543f340d service nova] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Detach interface failed, port_id=ec493035-93a3-4abd-bf09-60d845da9b22, reason: Instance d0da2b6b-cf1e-4222-b68a-20485c9676dd could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:44 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:05:44 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:05:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:44 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Deleted allocations for instance d0da2b6b-cf1e-4222-b68a-20485c9676dd
Jul 25 16:05:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c414ea11-1435-4411-8364-c4230b8d1535 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "d0da2b6b-cf1e-4222-b68a-20485c9676dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:05:52 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:05:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:52 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:52 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:05:53 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:05:53 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:05:53 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=25.367794036865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:05:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:05:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:05:53 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:05:53 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:05:53 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:05:53 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:05:53 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:05:53 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:05:54 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690301139.501416, 9b6561bc-a578-490b-b2f8-8ffa8e758ac8 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:05:54 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] VM Stopped (Lifecycle Event)
Jul 25 16:05:54 user nova-compute[70869]: DEBUG nova.compute.manager [None req-2d96195b-55e4-4d14-bddd-b8de2685a253 None None] [instance: 9b6561bc-a578-490b-b2f8-8ffa8e758ac8] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:05:56 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:57 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690301142.7245352, d0da2b6b-cf1e-4222-b68a-20485c9676dd => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:05:57 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] VM Stopped (Lifecycle Event)
Jul 25 16:05:57 user nova-compute[70869]: DEBUG nova.compute.manager [None req-77d6b0d8-b54d-4ef2-be3e-5bd890753ca2 None None] [instance: d0da2b6b-cf1e-4222-b68a-20485c9676dd] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:05:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:05:59 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:05:59 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:05:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:05:59 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:00 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:06:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:06:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 16:06:02 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:03 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:05 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:07 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:06:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:06:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:06:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:06:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:06:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:17 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:06:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:06:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "78222d49-ebb3-4802-82ad-8011ad009ab7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:06:30 user nova-compute[70869]: INFO nova.compute.claims [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Claim successful on node user
Jul 25 16:06:30 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG nova.network.neutron [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:06:30 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:06:30 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:06:30 user nova-compute[70869]: INFO nova.virt.block_device [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Booting with volume 6b72fca0-7d33-4213-b3f2-0583794eccf1 at /dev/vda
Jul 25 16:06:30 user nova-compute[70869]: DEBUG nova.policy [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f175a95c6c4e43b4b7d1910419070bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d4fe99fc224a2686f2f3daf32ecbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG os_brick.utils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49d62d5-6b10-448e-84f4-1355c68974e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9d0615-c7c5-48f1-95aa-beb864793aa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:30 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f4d6ab-530c-4730-9451-16b2d219f5ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5e6d70-0842-403a-a6ff-3e50a5b1e8eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:06:31 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:06:31 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f5d101-ea2c-489b-bce0-5b5ffa83fdec]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG os_brick.utils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updating existing volume attachment record: 431fad5c-709c-4c3a-a845-b302e6ec4ce2 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:06:31 user nova-compute[70869]: DEBUG nova.network.neutron [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Successfully created port: 0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:06:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:06:32 user nova-compute[70869]: DEBUG nova.network.neutron [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Successfully updated port: 0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:06:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:06:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquired lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:06:32 user nova-compute[70869]: DEBUG nova.network.neutron [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:06:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-0a32e1dc-eb6e-422e-80c5-51e9362f5cc3 req-2fef75b6-499b-4756-9522-b130d903a06d service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received event network-changed-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:06:32 user nova-compute[70869]: DEBUG nova.compute.manager [req-0a32e1dc-eb6e-422e-80c5-51e9362f5cc3 req-2fef75b6-499b-4756-9522-b130d903a06d service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Refreshing instance network info cache due to event network-changed-0135b119-0f76-46d1-a7fa-fad2d0be9ee2. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:06:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0a32e1dc-eb6e-422e-80c5-51e9362f5cc3 req-2fef75b6-499b-4756-9522-b130d903a06d service nova] Acquiring lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:06:32 user nova-compute[70869]: DEBUG nova.network.neutron [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:06:33 user nova-compute[70869]: DEBUG nova.network.neutron [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updating instance_info_cache with network_info: [{"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:06:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Releasing lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:06:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Instance network_info: |[{"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:06:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0a32e1dc-eb6e-422e-80c5-51e9362f5cc3 req-2fef75b6-499b-4756-9522-b130d903a06d service nova] Acquired lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:06:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-0a32e1dc-eb6e-422e-80c5-51e9362f5cc3 req-2fef75b6-499b-4756-9522-b130d903a06d service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Refreshing network info cache for port 0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:06:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-0a32e1dc-eb6e-422e-80c5-51e9362f5cc3 req-2fef75b6-499b-4756-9522-b130d903a06d service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updated VIF entry in instance network info cache for port 0135b119-0f76-46d1-a7fa-fad2d0be9ee2. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:06:33 user nova-compute[70869]: DEBUG nova.network.neutron [req-0a32e1dc-eb6e-422e-80c5-51e9362f5cc3 req-2fef75b6-499b-4756-9522-b130d903a06d service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updating instance_info_cache with network_info: [{"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:06:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-0a32e1dc-eb6e-422e-80c5-51e9362f5cc3 req-2fef75b6-499b-4756-9522-b130d903a06d service nova] Releasing lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:06:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:36 user nova-compute[70869]: DEBUG nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:06:37 user nova-compute[70869]: INFO nova.compute.claims [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Claim successful on node user
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.network.neutron [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:06:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.policy [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41de05146fc5424a9f4b4852a3739135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bbd6a3baf146179b81bda84bdd466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:06:37 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Creating image(s)
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "/opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "/opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.156s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk 1073741824 {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319,backing_fmt=raw /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk 1073741824" returned: 0 in 0.052s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "c3d7f00a7baf4b6ae169123cef207ab5cd766319" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319 --force-share --output=json" returned: 0 in 0.163s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:37 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk. size=1073741824 {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.network.neutron [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Successfully created port: 3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.disk.api [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Cannot resize image /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk to a smaller size. {{(pid=70869) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.objects.instance [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'migration_context' on Instance uuid b8647968-7b47-4844-9c6d-02e92d8ee999 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Created local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Ensure instance console log exists: /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:06:38 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Creating image(s)
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Ensure instance console log exists: /opt/stack/data/nova/instances/78222d49-ebb3-4802-82ad-8011ad009ab7/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Start _get_guest_xml network_info=[{"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '431fad5c-709c-4c3a-a845-b302e6ec4ce2', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdWzmLMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78222d49-ebb3-4802-82ad-8011ad009ab7', 'attached_at': '', 'detached_at': '', 'volume_id': '6b72fca0-7d33-4213-b3f2-0583794eccf1', 'serial': '6b72fca0-7d33-4213-b3f2-0583794eccf1'}, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:06:38 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:06:38 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdWzmLMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:06:38 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:06:38 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:06:38 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd232f3-cea9-4f4f-886d-10881c0cfb8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:06:38 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfefff5-0e1b-406a-85e8-12a392d956ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1] added
Jul 25 16:06:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae93d6f-ffc5-4abc-a350-f78e894faae8]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ca4a97-1a10-4164-ae27-9697961c1429]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdWzmLMH {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdWzmLMH" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c084af-c0e2-41c9-9d1f-146be58bb9cd]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RdWzmLMH'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c51aa8-d97e-4a65-8b1e-983a1ad5423c]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[81664c64-d0a8-42f6-a76a-34b25e5cd213]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:06:38 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 25 16:06:38 user nova-compute[70869]:  {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:06:38 user nova-compute[70869]: WARNING os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 25 16:06:38 user nova-compute[70869]: 
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d75209-da28-4f6f-96a7-eacc30aaae92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260]
Jul 25 16:06:38 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260] successful.
Jul 25 16:06:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8272da8-a833-403e-92d0-bb67f0c064ce]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d81e64-15a2-4c23-908d-bf1cc3e5ec8d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:06:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:06:38 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca8f9ef-9207-4929-aeca-b0cffea1f1ca]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:06:38 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdWzmLMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.neutron [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Successfully updated port: 3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquired lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.neutron [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-b734d161-7b7b-4d7b-b323-e7bb73b62c1f req-d2e7dd70-8bdc-43e3-85b8-48b47cfb264f service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received event network-changed-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.compute.manager [req-b734d161-7b7b-4d7b-b323-e7bb73b62c1f req-d2e7dd70-8bdc-43e3-85b8-48b47cfb264f service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Refreshing instance network info cache due to event network-changed-3643c773-082e-4443-b304-49ebbf0c712a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b734d161-7b7b-4d7b-b323-e7bb73b62c1f req-d2e7dd70-8bdc-43e3-85b8-48b47cfb264f service nova] Acquiring lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.neutron [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.neutron [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Updating instance_info_cache with network_info: [{"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Releasing lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Instance network_info: |[{"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b734d161-7b7b-4d7b-b323-e7bb73b62c1f req-d2e7dd70-8bdc-43e3-85b8-48b47cfb264f service nova] Acquired lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.neutron [req-b734d161-7b7b-4d7b-b323-e7bb73b62c1f req-d2e7dd70-8bdc-43e3-85b8-48b47cfb264f service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Refreshing network info cache for port 3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Start _get_guest_xml network_info=[{"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'image_id': 'c7f43ee3-f119-42a6-81e5-b18d0ee6d581'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:06:39 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:06:39 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-25T15:27:52Z,direct_url=<?>,disk_format='qcow2',id=c7f43ee3-f119-42a6-81e5-b18d0ee6d581,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='357c5a6c8220419bbbd4cf604f820a7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-25T15:27:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1867211563',display_name='tempest-AttachVolumeNegativeTest-server-1867211563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1867211563',id=50,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLj4ZvG0U+Zsi3I8a+zbhuJEQB7fdCVH81kux2wvQRF5WgBu3u6/9DoZ5tzgjjIvK7yqlG09NGln0W215CvXW/UWD9HxTjrV5T3fSS8HZWXrklxfS3DuZRyR5TgPaO+Qw==',key_name='tempest-keypair-600505416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-vc5cqsyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=b8647968-7b47-4844-9c6d-02e92d8ee999,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:72,bridge_name='br-int',has_traffic_filtering=True,id=3643c773-082e-4443-b304-49ebbf0c712a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3643c773-08') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'pci_devices' on Instance uuid b8647968-7b47-4844-9c6d-02e92d8ee999 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:06:39 user nova-compute[70869]:   <uuid>b8647968-7b47-4844-9c6d-02e92d8ee999</uuid>
Jul 25 16:06:39 user nova-compute[70869]:   <name>instance-00000032</name>
Jul 25 16:06:39 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 16:06:39 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 16:06:39 user nova-compute[70869]:   <metadata>
Jul 25 16:06:39 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:06:39 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1867211563</nova:name>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:creationTime>2023-07-25 16:06:39</nova:creationTime>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 16:06:39 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:06:39 user nova-compute[70869]:       </nova:flavor>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:owner>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:user uuid="41de05146fc5424a9f4b4852a3739135">tempest-AttachVolumeNegativeTest-1624272753-project-member</nova:user>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:project uuid="82bbd6a3baf146179b81bda84bdd466a">tempest-AttachVolumeNegativeTest-1624272753</nova:project>
Jul 25 16:06:39 user nova-compute[70869]:       </nova:owner>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:root type="image" uuid="c7f43ee3-f119-42a6-81e5-b18d0ee6d581"/>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:ports>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:port uuid="3643c773-082e-4443-b304-49ebbf0c712a">
Jul 25 16:06:39 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 16:06:39 user nova-compute[70869]:         </nova:port>
Jul 25 16:06:39 user nova-compute[70869]:       </nova:ports>
Jul 25 16:06:39 user nova-compute[70869]:     </nova:instance>
Jul 25 16:06:39 user nova-compute[70869]:   </metadata>
Jul 25 16:06:39 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 16:06:39 user nova-compute[70869]:     <system>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="serial">b8647968-7b47-4844-9c6d-02e92d8ee999</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="uuid">b8647968-7b47-4844-9c6d-02e92d8ee999</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:06:39 user nova-compute[70869]:     </system>
Jul 25 16:06:39 user nova-compute[70869]:   </sysinfo>
Jul 25 16:06:39 user nova-compute[70869]:   <os>
Jul 25 16:06:39 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:06:39 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 16:06:39 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 16:06:39 user nova-compute[70869]:   </os>
Jul 25 16:06:39 user nova-compute[70869]:   <features>
Jul 25 16:06:39 user nova-compute[70869]:     <acpi/>
Jul 25 16:06:39 user nova-compute[70869]:     <apic/>
Jul 25 16:06:39 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 16:06:39 user nova-compute[70869]:   </features>
Jul 25 16:06:39 user nova-compute[70869]:   <clock offset="utc">
Jul 25 16:06:39 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:06:39 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:06:39 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 16:06:39 user nova-compute[70869]:   </clock>
Jul 25 16:06:39 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 16:06:39 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 16:06:39 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:06:39 user nova-compute[70869]:   </cpu>
Jul 25 16:06:39 user nova-compute[70869]:   <devices>
Jul 25 16:06:39 user nova-compute[70869]:     <disk type="file" device="disk">
Jul 25 16:06:39 user nova-compute[70869]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 25 16:06:39 user nova-compute[70869]:       <source file="/opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk"/>
Jul 25 16:06:39 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 16:06:39 user nova-compute[70869]:     </disk>
Jul 25 16:06:39 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 16:06:39 user nova-compute[70869]:       <mac address="fa:16:3e:9e:09:72"/>
Jul 25 16:06:39 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:06:39 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 16:06:39 user nova-compute[70869]:       <target dev="tap3643c773-08"/>
Jul 25 16:06:39 user nova-compute[70869]:     </interface>
Jul 25 16:06:39 user nova-compute[70869]:     <serial type="pty">
Jul 25 16:06:39 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/console.log" append="off"/>
Jul 25 16:06:39 user nova-compute[70869]:     </serial>
Jul 25 16:06:39 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:06:39 user nova-compute[70869]:     <video>
Jul 25 16:06:39 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:06:39 user nova-compute[70869]:     </video>
Jul 25 16:06:39 user nova-compute[70869]:     <rng model="virtio">
Jul 25 16:06:39 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:06:39 user nova-compute[70869]:     </rng>
Jul 25 16:06:39 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:06:39 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 16:06:39 user nova-compute[70869]:       <stats period="10"/>
Jul 25 16:06:39 user nova-compute[70869]:     </memballoon>
Jul 25 16:06:39 user nova-compute[70869]:   </devices>
Jul 25 16:06:39 user nova-compute[70869]: </domain>
Jul 25 16:06:39 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1867211563',display_name='tempest-AttachVolumeNegativeTest-server-1867211563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1867211563',id=50,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLj4ZvG0U+Zsi3I8a+zbhuJEQB7fdCVH81kux2wvQRF5WgBu3u6/9DoZ5tzgjjIvK7yqlG09NGln0W215CvXW/UWD9HxTjrV5T3fSS8HZWXrklxfS3DuZRyR5TgPaO+Qw==',key_name='tempest-keypair-600505416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-vc5cqsyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=b8647968-7b47-4844-9c6d-02e92d8ee999,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:72,bridge_name='br-int',has_traffic_filtering=True,id=3643c773-082e-4443-b304-49ebbf0c712a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3643c773-08') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG os_vif [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:72,bridge_name='br-int',has_traffic_filtering=True,id=3643c773-082e-4443-b304-49ebbf0c712a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3643c773-08') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3643c773-08, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3643c773-08, col_values=(('external_ids', {'iface-id': '3643c773-082e-4443-b304-49ebbf0c712a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:09:72', 'vm-uuid': 'b8647968-7b47-4844-9c6d-02e92d8ee999'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:39 user nova-compute[70869]: INFO os_vif [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:72,bridge_name='br-int',has_traffic_filtering=True,id=3643c773-082e-4443-b304-49ebbf0c712a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3643c773-08')
Jul 25 16:06:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23234653537363039', 'path': '/dev/sdb'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234653537363039', 'path': '/dev/sdb'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No VIF found with MAC fa:16:3e:9e:09:72, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1116822430',display_name='tempest-TestVolumeBootPattern-server-1116822430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1116822430',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqjb/4INnE5Q7haEGBoiJ2p8MTmRd3cHvxRoqpkDS9ZbSbKgpJ0XXSjxTNNldbDFAEx8QJ4zDRTocfDJ/QShLCT2MbOT51gi80w4AHoAQQEx2d5MZTCofThyZZ/3b0Hig==',key_name='tempest-TestVolumeBootPattern-1263460613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-ton1ftr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:06:31Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=78222d49-ebb3-4802-82ad-8011ad009ab7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:79:52,bridge_name='br-int',has_traffic_filtering=True,id=0135b119-0f76-46d1-a7fa-fad2d0be9ee2,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0135b119-0f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'pci_devices' on Instance uuid 78222d49-ebb3-4802-82ad-8011ad009ab7 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:06:39 user nova-compute[70869]:   <uuid>78222d49-ebb3-4802-82ad-8011ad009ab7</uuid>
Jul 25 16:06:39 user nova-compute[70869]:   <name>instance-00000031</name>
Jul 25 16:06:39 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 16:06:39 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 16:06:39 user nova-compute[70869]:   <metadata>
Jul 25 16:06:39 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:06:39 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:name>tempest-TestVolumeBootPattern-server-1116822430</nova:name>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:creationTime>2023-07-25 16:06:38</nova:creationTime>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 16:06:39 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:06:39 user nova-compute[70869]:       </nova:flavor>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:owner>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:user uuid="f175a95c6c4e43b4b7d1910419070bf7">tempest-TestVolumeBootPattern-1492727042-project-member</nova:user>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:project uuid="a0d4fe99fc224a2686f2f3daf32ecbd5">tempest-TestVolumeBootPattern-1492727042</nova:project>
Jul 25 16:06:39 user nova-compute[70869]:       </nova:owner>
Jul 25 16:06:39 user nova-compute[70869]:       <nova:ports>
Jul 25 16:06:39 user nova-compute[70869]:         <nova:port uuid="0135b119-0f76-46d1-a7fa-fad2d0be9ee2">
Jul 25 16:06:39 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 25 16:06:39 user nova-compute[70869]:         </nova:port>
Jul 25 16:06:39 user nova-compute[70869]:       </nova:ports>
Jul 25 16:06:39 user nova-compute[70869]:     </nova:instance>
Jul 25 16:06:39 user nova-compute[70869]:   </metadata>
Jul 25 16:06:39 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 16:06:39 user nova-compute[70869]:     <system>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="serial">78222d49-ebb3-4802-82ad-8011ad009ab7</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="uuid">78222d49-ebb3-4802-82ad-8011ad009ab7</entry>
Jul 25 16:06:39 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:06:39 user nova-compute[70869]:     </system>
Jul 25 16:06:39 user nova-compute[70869]:   </sysinfo>
Jul 25 16:06:39 user nova-compute[70869]:   <os>
Jul 25 16:06:39 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:06:39 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 16:06:39 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 16:06:39 user nova-compute[70869]:   </os>
Jul 25 16:06:39 user nova-compute[70869]:   <features>
Jul 25 16:06:39 user nova-compute[70869]:     <acpi/>
Jul 25 16:06:39 user nova-compute[70869]:     <apic/>
Jul 25 16:06:39 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 16:06:39 user nova-compute[70869]:   </features>
Jul 25 16:06:39 user nova-compute[70869]:   <clock offset="utc">
Jul 25 16:06:39 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:06:39 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:06:39 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 16:06:39 user nova-compute[70869]:   </clock>
Jul 25 16:06:39 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 16:06:39 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 16:06:39 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:06:39 user nova-compute[70869]:   </cpu>
Jul 25 16:06:39 user nova-compute[70869]:   <devices>
Jul 25 16:06:39 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 16:06:39 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:06:39 user nova-compute[70869]:       <source dev="/dev/sdb"/>
Jul 25 16:06:39 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 16:06:39 user nova-compute[70869]:       <serial>6b72fca0-7d33-4213-b3f2-0583794eccf1</serial>
Jul 25 16:06:39 user nova-compute[70869]:     </disk>
Jul 25 16:06:39 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 16:06:39 user nova-compute[70869]:       <mac address="fa:16:3e:12:79:52"/>
Jul 25 16:06:39 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:06:39 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 16:06:39 user nova-compute[70869]:       <target dev="tap0135b119-0f"/>
Jul 25 16:06:39 user nova-compute[70869]:     </interface>
Jul 25 16:06:39 user nova-compute[70869]:     <serial type="pty">
Jul 25 16:06:39 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/78222d49-ebb3-4802-82ad-8011ad009ab7/console.log" append="off"/>
Jul 25 16:06:39 user nova-compute[70869]:     </serial>
Jul 25 16:06:39 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:06:39 user nova-compute[70869]:     <video>
Jul 25 16:06:39 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:06:39 user nova-compute[70869]:     </video>
Jul 25 16:06:39 user nova-compute[70869]:     <rng model="virtio">
Jul 25 16:06:39 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:06:39 user nova-compute[70869]:     </rng>
Jul 25 16:06:39 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:06:39 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 16:06:39 user nova-compute[70869]:       <stats period="10"/>
Jul 25 16:06:39 user nova-compute[70869]:     </memballoon>
Jul 25 16:06:39 user nova-compute[70869]:   </devices>
Jul 25 16:06:39 user nova-compute[70869]: </domain>
Jul 25 16:06:39 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1116822430',display_name='tempest-TestVolumeBootPattern-server-1116822430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1116822430',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqjb/4INnE5Q7haEGBoiJ2p8MTmRd3cHvxRoqpkDS9ZbSbKgpJ0XXSjxTNNldbDFAEx8QJ4zDRTocfDJ/QShLCT2MbOT51gi80w4AHoAQQEx2d5MZTCofThyZZ/3b0Hig==',key_name='tempest-TestVolumeBootPattern-1263460613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-ton1ftr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:06:31Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=78222d49-ebb3-4802-82ad-8011ad009ab7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:79:52,bridge_name='br-int',has_traffic_filtering=True,id=0135b119-0f76-46d1-a7fa-fad2d0be9ee2,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0135b119-0f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG os_vif [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:79:52,bridge_name='br-int',has_traffic_filtering=True,id=0135b119-0f76-46d1-a7fa-fad2d0be9ee2,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0135b119-0f') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0135b119-0f, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0135b119-0f, col_values=(('external_ids', {'iface-id': '0135b119-0f76-46d1-a7fa-fad2d0be9ee2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:79:52', 'vm-uuid': '78222d49-ebb3-4802-82ad-8011ad009ab7'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:39 user nova-compute[70869]: INFO os_vif [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:79:52,bridge_name='br-int',has_traffic_filtering=True,id=0135b119-0f76-46d1-a7fa-fad2d0be9ee2,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0135b119-0f')
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No VIF found with MAC fa:16:3e:12:79:52, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.neutron [req-b734d161-7b7b-4d7b-b323-e7bb73b62c1f req-d2e7dd70-8bdc-43e3-85b8-48b47cfb264f service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Updated VIF entry in instance network info cache for port 3643c773-082e-4443-b304-49ebbf0c712a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG nova.network.neutron [req-b734d161-7b7b-4d7b-b323-e7bb73b62c1f req-d2e7dd70-8bdc-43e3-85b8-48b47cfb264f service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Updating instance_info_cache with network_info: [{"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:06:39 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b734d161-7b7b-4d7b-b323-e7bb73b62c1f req-d2e7dd70-8bdc-43e3-85b8-48b47cfb264f service nova] Releasing lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:06:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-40d87da1-96ed-4491-9c53-1586ec2b191d req-928344ec-b4bc-4796-b91b-266811700ddc service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received event network-vif-plugged-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-40d87da1-96ed-4491-9c53-1586ec2b191d req-928344ec-b4bc-4796-b91b-266811700ddc service nova] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-40d87da1-96ed-4491-9c53-1586ec2b191d req-928344ec-b4bc-4796-b91b-266811700ddc service nova] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-40d87da1-96ed-4491-9c53-1586ec2b191d req-928344ec-b4bc-4796-b91b-266811700ddc service nova] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG nova.compute.manager [req-40d87da1-96ed-4491-9c53-1586ec2b191d req-928344ec-b4bc-4796-b91b-266811700ddc service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] No waiting events found dispatching network-vif-plugged-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:06:42 user nova-compute[70869]: WARNING nova.compute.manager [req-40d87da1-96ed-4491-9c53-1586ec2b191d req-928344ec-b4bc-4796-b91b-266811700ddc service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received unexpected event network-vif-plugged-3643c773-082e-4443-b304-49ebbf0c712a for instance with vm_state building and task_state spawning.
Jul 25 16:06:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received event network-vif-plugged-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] No waiting events found dispatching network-vif-plugged-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:06:44 user nova-compute[70869]: WARNING nova.compute.manager [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received unexpected event network-vif-plugged-3643c773-082e-4443-b304-49ebbf0c712a for instance with vm_state building and task_state spawning.
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received event network-vif-plugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] Acquiring lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] No waiting events found dispatching network-vif-plugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:06:44 user nova-compute[70869]: WARNING nova.compute.manager [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received unexpected event network-vif-plugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 for instance with vm_state building and task_state spawning.
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received event network-vif-plugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] Acquiring lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] No waiting events found dispatching network-vif-plugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:06:44 user nova-compute[70869]: WARNING nova.compute.manager [req-5c8ecf54-ac4f-4c15-a0e2-56986534d3a9 req-f4262ecb-9f18-42c5-b459-d00876d29b5b service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received unexpected event network-vif-plugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 for instance with vm_state building and task_state spawning.
Jul 25 16:06:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690301204.8183885, 78222d49-ebb3-4802-82ad-8011ad009ab7 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:06:44 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] VM Resumed (Lifecycle Event)
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:06:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Instance spawned successfully.
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:06:44 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Instance spawned successfully.
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:06:44 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690301204.822604, 78222d49-ebb3-4802-82ad-8011ad009ab7 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:06:44 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] VM Started (Lifecycle Event)
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:06:44 user nova-compute[70869]: INFO nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Took 7.51 seconds to spawn the instance on the hypervisor.
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:06:44 user nova-compute[70869]: INFO nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Took 6.70 seconds to spawn the instance on the hypervisor.
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:06:44 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:06:44 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690301204.824354, b8647968-7b47-4844-9c6d-02e92d8ee999 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:06:44 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] VM Resumed (Lifecycle Event)
Jul 25 16:06:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:06:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:06:45 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:06:45 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690301204.8273776, b8647968-7b47-4844-9c6d-02e92d8ee999 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:06:45 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] VM Started (Lifecycle Event)
Jul 25 16:06:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:06:45 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:06:45 user nova-compute[70869]: INFO nova.compute.manager [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Took 8.10 seconds to build instance.
Jul 25 16:06:45 user nova-compute[70869]: INFO nova.compute.manager [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Took 14.61 seconds to build instance.
Jul 25 16:06:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-9ed48082-5e4f-426a-b5e2-f2eb60bff1c6 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.230s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:45 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ae0ca142-bf3c-4703-969a-5b1ac9edd08a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.724s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:06:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:54 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:54 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:06:54 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:06:54 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:06:55 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:06:55 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:06:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8681MB free_disk=25.363296508789062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 78222d49-ebb3-4802-82ad-8011ad009ab7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance b8647968-7b47-4844-9c6d-02e92d8ee999 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:06:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:06:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:06:59 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:59 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:06:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:07:01 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:07:02 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:07:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:07:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:07:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:07:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:07:02 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:07:02 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid 78222d49-ebb3-4802-82ad-8011ad009ab7 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:07:03 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updating instance_info_cache with network_info: [{"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:07:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:07:03 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:07:03 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:07:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:04 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:07:07 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:07:08 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:07:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Verify base images {{(pid=70869) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Image id c7f43ee3-f119-42a6-81e5-b18d0ee6d581 yields fingerprint c3d7f00a7baf4b6ae169123cef207ab5cd766319 {{(pid=70869) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] image c7f43ee3-f119-42a6-81e5-b18d0ee6d581 at (/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319): checking
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] image c7f43ee3-f119-42a6-81e5-b18d0ee6d581 at (/opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319): image is in use {{(pid=70869) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=70869) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] 78222d49-ebb3-4802-82ad-8011ad009ab7 is a valid instance name {{(pid=70869) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] b8647968-7b47-4844-9c6d-02e92d8ee999 is a valid instance name {{(pid=70869) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] b8647968-7b47-4844-9c6d-02e92d8ee999 has a disk file {{(pid=70869) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance b8647968-7b47-4844-9c6d-02e92d8ee999 is backed by c3d7f00a7baf4b6ae169123cef207ab5cd766319 {{(pid=70869) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 25 16:07:22 user nova-compute[70869]: WARNING nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Unknown base file: /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134
Jul 25 16:07:22 user nova-compute[70869]: WARNING nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Unknown base file: /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c
Jul 25 16:07:22 user nova-compute[70869]: WARNING nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Unknown base file: /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e
Jul 25 16:07:22 user nova-compute[70869]: WARNING nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Unknown base file: /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573
Jul 25 16:07:22 user nova-compute[70869]: WARNING nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Unknown base file: /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce
Jul 25 16:07:22 user nova-compute[70869]: WARNING nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Unknown base file: /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c
Jul 25 16:07:22 user nova-compute[70869]: WARNING nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Unknown base file: /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32
Jul 25 16:07:22 user nova-compute[70869]: WARNING nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Unknown base file: /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40
Jul 25 16:07:22 user nova-compute[70869]: WARNING nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Unknown base file: /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Active base files: /opt/stack/data/nova/instances/_base/c3d7f00a7baf4b6ae169123cef207ab5cd766319
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Removable base files: /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134 /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573 /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32 /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40 /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3dbe680999be8bde98134e1e5ebefeb8ad2e0134
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/de8def195b8ea0783921cbc4136f6c39186e925c
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fec04bebf09c5d870deb5dbf323e0cb2985a408e
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d80914968c57642f5138a2c13b5c78c54865b573
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dfa204b660194b29a3665940772ce33d5887cfce
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c7c47ca22fa78fcb8dfd9ed36305b26fc0d3e40c
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1fa0458252ba80e92e6625d03b78892cf4c74a32
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5778590daafe7dbd64801671125503b1b8007c40
Jul 25 16:07:22 user nova-compute[70869]: INFO nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7cb9f5ba457adc702ddce8d74f23543c0c6745e5
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Verification complete {{(pid=70869) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Verify swap images {{(pid=70869) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 25 16:07:22 user nova-compute[70869]: DEBUG nova.virt.libvirt.imagecache [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Verify ephemeral images {{(pid=70869) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 25 16:07:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:07:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:07:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:07:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:07:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:07:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:07:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:07:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:07:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:07:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:07:49 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:07:54 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:07:55 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:07:55 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:07:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8726MB free_disk=25.33464813232422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 78222d49-ebb3-4802-82ad-8011ad009ab7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance b8647968-7b47-4844-9c6d-02e92d8ee999 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:07:55 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:07:56 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:07:56 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:07:56 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:07:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:07:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:07:59 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:07:59 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:08:00 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:02 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:08:04 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:08:05 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Updating instance_info_cache with network_info: [{"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:08:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:08:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:08:05 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:05 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:08 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:09 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:12 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:12 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances with incomplete migration  {{(pid=70869) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 25 16:08:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:08:18 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:19 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:08:21 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-3fbc878d-7bce-4099-b163-b31be1abf38b req-c4a3a26f-c199-430d-aeaf-8708f4a8bb4e service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received event network-changed-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:08:22 user nova-compute[70869]: DEBUG nova.compute.manager [req-3fbc878d-7bce-4099-b163-b31be1abf38b req-c4a3a26f-c199-430d-aeaf-8708f4a8bb4e service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Refreshing instance network info cache due to event network-changed-0135b119-0f76-46d1-a7fa-fad2d0be9ee2. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:08:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3fbc878d-7bce-4099-b163-b31be1abf38b req-c4a3a26f-c199-430d-aeaf-8708f4a8bb4e service nova] Acquiring lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:08:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3fbc878d-7bce-4099-b163-b31be1abf38b req-c4a3a26f-c199-430d-aeaf-8708f4a8bb4e service nova] Acquired lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:08:22 user nova-compute[70869]: DEBUG nova.network.neutron [req-3fbc878d-7bce-4099-b163-b31be1abf38b req-c4a3a26f-c199-430d-aeaf-8708f4a8bb4e service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Refreshing network info cache for port 0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:08:22 user nova-compute[70869]: DEBUG nova.network.neutron [req-3fbc878d-7bce-4099-b163-b31be1abf38b req-c4a3a26f-c199-430d-aeaf-8708f4a8bb4e service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updated VIF entry in instance network info cache for port 0135b119-0f76-46d1-a7fa-fad2d0be9ee2. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:08:22 user nova-compute[70869]: DEBUG nova.network.neutron [req-3fbc878d-7bce-4099-b163-b31be1abf38b req-c4a3a26f-c199-430d-aeaf-8708f4a8bb4e service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updating instance_info_cache with network_info: [{"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:08:22 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-3fbc878d-7bce-4099-b163-b31be1abf38b req-c4a3a26f-c199-430d-aeaf-8708f4a8bb4e service nova] Releasing lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:08:23 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 25 16:08:23 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] There are 0 instances to clean {{(pid=70869) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 25 16:08:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:24 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:27 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-4f0bd103-1865-4298-a36b-ccada3984e00 req-954328e2-a070-46e9-b95f-1849364b38fc service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received event network-changed-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:08:28 user nova-compute[70869]: DEBUG nova.compute.manager [req-4f0bd103-1865-4298-a36b-ccada3984e00 req-954328e2-a070-46e9-b95f-1849364b38fc service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Refreshing instance network info cache due to event network-changed-3643c773-082e-4443-b304-49ebbf0c712a. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:08:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4f0bd103-1865-4298-a36b-ccada3984e00 req-954328e2-a070-46e9-b95f-1849364b38fc service nova] Acquiring lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:08:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4f0bd103-1865-4298-a36b-ccada3984e00 req-954328e2-a070-46e9-b95f-1849364b38fc service nova] Acquired lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:08:28 user nova-compute[70869]: DEBUG nova.network.neutron [req-4f0bd103-1865-4298-a36b-ccada3984e00 req-954328e2-a070-46e9-b95f-1849364b38fc service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Refreshing network info cache for port 3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:08:29 user nova-compute[70869]: DEBUG nova.network.neutron [req-4f0bd103-1865-4298-a36b-ccada3984e00 req-954328e2-a070-46e9-b95f-1849364b38fc service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Updated VIF entry in instance network info cache for port 3643c773-082e-4443-b304-49ebbf0c712a. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:08:29 user nova-compute[70869]: DEBUG nova.network.neutron [req-4f0bd103-1865-4298-a36b-ccada3984e00 req-954328e2-a070-46e9-b95f-1849364b38fc service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Updating instance_info_cache with network_info: [{"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:08:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-4f0bd103-1865-4298-a36b-ccada3984e00 req-954328e2-a070-46e9-b95f-1849364b38fc service nova] Releasing lock "refresh_cache-b8647968-7b47-4844-9c6d-02e92d8ee999" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:08:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'flavor' on Instance uuid b8647968-7b47-4844-9c6d-02e92d8ee999 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:32 user nova-compute[70869]: INFO nova.compute.manager [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Attaching volume e91c1b17-894e-4ba5-a7fa-c1722da35121 to /dev/vdb
Jul 25 16:08:32 user nova-compute[70869]: DEBUG os_brick.utils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edbb7c1-d0f5-45ff-8b12-f85916688d87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b743d482-a471-491f-8b1e-999f5f33cb2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[974cbb46-92c2-4b01-80e7-0423b525ca7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f361f-ff41-4e2e-8340-9ed979d2256a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:08:32 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:08:32 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[72700fdb-0e28-46b5-9f2d-df78dea1e172]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG os_brick.utils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:08:32 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Updating existing volume attachment record: 38b46379-3d9c-44ed-8c26-9508da25a9a6 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Starting instance... {{(pid=70869) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70869) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 25 16:08:33 user nova-compute[70869]: INFO nova.compute.claims [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Claim successful on node user
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Refreshing inventories for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Updating ProviderTree inventory for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Updating inventory in ProviderTree for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Refreshing aggregate associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, aggregates: None {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Refreshing trait associations for resource provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41 {{(pid=70869) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Start building networks asynchronously for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Allocating IP information in the background. {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.network.neutron [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] allocate_for_instance() {{(pid=70869) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 25 16:08:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Start building block device mappings for instance. {{(pid=70869) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 25 16:08:33 user nova-compute[70869]: INFO nova.virt.block_device [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Booting with volume db860f91-9ec2-45a2-984a-fbec37218379 at /dev/vda
Jul 25 16:08:33 user nova-compute[70869]: DEBUG nova.policy [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f175a95c6c4e43b4b7d1910419070bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0d4fe99fc224a2686f2f3daf32ecbd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70869) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG os_brick.utils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[44652cda-2752-4c78-b9e3-a2b963896687]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:689126a270fa\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5646e1e0-063f-498b-b5a9-29240134176d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:33 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4c9082-609f-43b3-94e2-8c3685673b7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de3615b-d7ff-4b38-a006-1d21943c0772]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Running cmd (subprocess): nvme version {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] 'nvme version' failed. Not Retrying. {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] nvme not present on system {{(pid=70869) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 25 16:08:34 user nova-compute[70869]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 25 16:08:34 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5158e1a3-cb85-4758-9a64-dba2042069de]: (4, '') {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70869) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.lightos [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] LIGHTOS: no hostnqn found. {{(pid=70869) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG os_brick.utils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:689126a270fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG nova.virt.block_device [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updating existing volume attachment record: 41afe4fb-25b3-4579-9a63-c7a822fbdf43 {{(pid=70869) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG nova.network.neutron [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Successfully created port: 0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Successfully updated port: 0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquired lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Building network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-e275077e-b7f4-4c62-898a-ebeb4f5f442b req-d177beb7-1087-4865-8de4-e9f8be1f811a service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received event network-changed-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-e275077e-b7f4-4c62-898a-ebeb4f5f442b req-d177beb7-1087-4865-8de4-e9f8be1f811a service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Refreshing instance network info cache due to event network-changed-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e275077e-b7f4-4c62-898a-ebeb4f5f442b req-d177beb7-1087-4865-8de4-e9f8be1f811a service nova] Acquiring lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Instance cache missing network info. {{(pid=70869) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG nova.network.neutron [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updating instance_info_cache with network_info: [{"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Releasing lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Instance network_info: |[{"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70869) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e275077e-b7f4-4c62-898a-ebeb4f5f442b req-d177beb7-1087-4865-8de4-e9f8be1f811a service nova] Acquired lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:08:35 user nova-compute[70869]: DEBUG nova.network.neutron [req-e275077e-b7f4-4c62-898a-ebeb4f5f442b req-d177beb7-1087-4865-8de4-e9f8be1f811a service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Refreshing network info cache for port 0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:08:36 user nova-compute[70869]: DEBUG nova.network.neutron [req-e275077e-b7f4-4c62-898a-ebeb4f5f442b req-d177beb7-1087-4865-8de4-e9f8be1f811a service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updated VIF entry in instance network info cache for port 0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:08:36 user nova-compute[70869]: DEBUG nova.network.neutron [req-e275077e-b7f4-4c62-898a-ebeb4f5f442b req-d177beb7-1087-4865-8de4-e9f8be1f811a service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updating instance_info_cache with network_info: [{"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:08:36 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-e275077e-b7f4-4c62-898a-ebeb4f5f442b req-d177beb7-1087-4865-8de4-e9f8be1f811a service nova] Releasing lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGOeyWJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:08:39 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:08:39 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:08:39 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[484fad26-8f10-4b27-b458-cc12baa499f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:08:39 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[81de0a6f-d28e-48e0-9bb9-e35fa481757f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121] added
Jul 25 16:08:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9800e20-3ad2-4db5-99b3-fd4e88bcdb1f]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f1eb5-eb14-4189-9c6f-5d47ed58b6e6]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGOeyWJd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGOeyWJd" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e0c602-a957-4745-9e3b-05cef6304494]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGOeyWJd'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[238e3ac9-320b-442a-9e64-e5061a1d5e0a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c8e3a1-375e-414c-b20e-745eb8b2faf9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab8979-7f78-4d4c-87c1-8365eb116c37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121, portal: 172.16.0.220,3260]
Jul 25 16:08:39 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121, portal: 172.16.0.220,3260] successful.
Jul 25 16:08:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f8dd87-ffca-4d74-a8c7-a94116710f43]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa475ee3-1e9d-4e7d-bb27-04859c24c4ec]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:39 user nova-compute[70869]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)
Jul 25 16:08:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:39 user nova-compute[70869]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)
Jul 25 16:08:39 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12aaf91-b95f-4f74-8f2a-5b32bcae495e]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:39 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGOeyWJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26165346266633732', 'path': '/dev/sdc'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165346266633732', 'path': '/dev/sdc'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG nova.objects.instance [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'flavor' on Instance uuid b8647968-7b47-4844-9c6d-02e92d8ee999 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] attach device xml: <disk type="block" device="disk">
Jul 25 16:08:40 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:08:40 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 16:08:40 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:08:40 user nova-compute[70869]:   <serial>e91c1b17-894e-4ba5-a7fa-c1722da35121</serial>
Jul 25 16:08:40 user nova-compute[70869]: </disk>
Jul 25 16:08:40 user nova-compute[70869]:  {{(pid=70869) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:08:40 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] No VIF found with MAC fa:16:3e:9e:09:72, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Start spawning the instance on the hypervisor. {{(pid=70869) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Creating instance directory {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 25 16:08:41 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Creating image(s)
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Did not create local disks {{(pid=70869) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Ensure instance console log exists: /opt/stack/data/nova/instances/fd9d5d60-beba-4c0c-ba39-31ac33f63f91/console.log {{(pid=70869) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Start _get_guest_xml network_info=[{"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '41afe4fb-25b3-4579-9a63-c7a822fbdf43', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZsThjrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd9d5d60-beba-4c0c-ba39-31ac33f63f91', 'attached_at': '', 'detached_at': '', 'volume_id': 'db860f91-9ec2-45a2-984a-fbec37218379', 'serial': 'db860f91-9ec2-45a2-984a-fbec37218379'}, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 25 16:08:41 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:08:41 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller missing on host. {{(pid=70869) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.host [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU controller found on host. {{(pid=70869) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70869) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-25T15:27:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image limits 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flavor pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Image pref 0:0:0 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Got 1 possible topologies {{(pid=70869) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.hardware [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70869) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Calling os-brick to attach iSCSI Volume {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZsThjrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:08:41 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:08:41 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:08:41 user nova-compute[70869]: INFO os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a075d63-dfa1-4409-8fb1-a150a2ad02a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 25 16:08:41 user nova-compute[70869]:  {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --interface default --op new {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d110f7c-38d8-49bc-b5ed-32dedc2bd0ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379] added\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379] added
Jul 25 16:08:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d89c2b-6f31-403f-8abe-d5339137ca11]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619b05e-fca9-4214-ba9b-fb99f28c3f40]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZsThjrt {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZsThjrt" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[85af215b-acc5-4edf-a9ef-349c196305bf]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NZsThjrt'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-ce6b42ba-88e3-4a51-8d91-f220914e8020 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.932s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[87826e9e-4b94-45c2-8f9c-52480b3a401e]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cde953a-cfb3-431d-b3fd-48b09254f711]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --login {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2552e8-580e-4a3f-b836-bfc807b04b85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379, portal: 172.16.0.220,3260]
Jul 25 16:08:41 user nova-compute[70869]: Login to [iface: default, target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379, portal: 172.16.0.220,3260] successful.
Jul 25 16:08:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[260af16d-f862-4d1a-be96-072dacc8567a]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9ebbd-a3fe-4793-8c89-fa8d2c5ba7cd]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 (non-flash)
Jul 25 16:08:41 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to 172.16.0.220:3260 {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=70869) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70869) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.084s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[01323927-9005-4a17-8b05-39cc097650e3]: (4, ('- - 0', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:41 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: None {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:42 user nova-compute[70869]: INFO nova.compute.manager [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Detaching volume e91c1b17-894e-4ba5-a7fa-c1722da35121
Jul 25 16:08:42 user nova-compute[70869]: INFO nova.virt.block_device [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Attempting to driver detach volume e91c1b17-894e-4ba5-a7fa-c1722da35121 from mountpoint /dev/vdb
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Attempting to detach device vdb from instance b8647968-7b47-4844-9c6d-02e92d8ee999 from the persistent domain config. {{(pid=70869) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:08:42 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:08:42 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 16:08:42 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:08:42 user nova-compute[70869]:   <serial>e91c1b17-894e-4ba5-a7fa-c1722da35121</serial>
Jul 25 16:08:42 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:08:42 user nova-compute[70869]: </disk>
Jul 25 16:08:42 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:08:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully detached device vdb from instance b8647968-7b47-4844-9c6d-02e92d8ee999 from the persistent domain config.
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8647968-7b47-4844-9c6d-02e92d8ee999 from the live domain config. {{(pid=70869) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.guest [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] detach device xml: <disk type="block" device="disk">
Jul 25 16:08:42 user nova-compute[70869]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:08:42 user nova-compute[70869]:   <source dev="/dev/sdc"/>
Jul 25 16:08:42 user nova-compute[70869]:   <target dev="vdb" bus="virtio"/>
Jul 25 16:08:42 user nova-compute[70869]:   <serial>e91c1b17-894e-4ba5-a7fa-c1722da35121</serial>
Jul 25 16:08:42 user nova-compute[70869]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 25 16:08:42 user nova-compute[70869]: </disk>
Jul 25 16:08:42 user nova-compute[70869]:  {{(pid=70869) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70869) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZsThjrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70869) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26564643439623036', 'path': '/dev/sdd'} {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564643439623036', 'path': '/dev/sdd'} {{(pid=70869) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337339313',display_name='tempest-TestVolumeBootPattern-server-337339313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-337339313',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqjb/4INnE5Q7haEGBoiJ2p8MTmRd3cHvxRoqpkDS9ZbSbKgpJ0XXSjxTNNldbDFAEx8QJ4zDRTocfDJ/QShLCT2MbOT51gi80w4AHoAQQEx2d5MZTCofThyZZ/3b0Hig==',key_name='tempest-TestVolumeBootPattern-1263460613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-096y062k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:08:34Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=fd9d5d60-beba-4c0c-ba39-31ac33f63f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70869) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:2d:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa3d27e-6c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.objects.instance [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'pci_devices' on Instance uuid fd9d5d60-beba-4c0c-ba39-31ac33f63f91 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] End _get_guest_xml xml=<domain type="kvm">
Jul 25 16:08:42 user nova-compute[70869]:   <uuid>fd9d5d60-beba-4c0c-ba39-31ac33f63f91</uuid>
Jul 25 16:08:42 user nova-compute[70869]:   <name>instance-00000033</name>
Jul 25 16:08:42 user nova-compute[70869]:   <memory>524288</memory>
Jul 25 16:08:42 user nova-compute[70869]:   <vcpu>1</vcpu>
Jul 25 16:08:42 user nova-compute[70869]:   <metadata>
Jul 25 16:08:42 user nova-compute[70869]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 25 16:08:42 user nova-compute[70869]:       <nova:package version="0.0.0"/>
Jul 25 16:08:42 user nova-compute[70869]:       <nova:name>tempest-TestVolumeBootPattern-server-337339313</nova:name>
Jul 25 16:08:42 user nova-compute[70869]:       <nova:creationTime>2023-07-25 16:08:41</nova:creationTime>
Jul 25 16:08:42 user nova-compute[70869]:       <nova:flavor name="m1.tiny">
Jul 25 16:08:42 user nova-compute[70869]:         <nova:memory>512</nova:memory>
Jul 25 16:08:42 user nova-compute[70869]:         <nova:disk>1</nova:disk>
Jul 25 16:08:42 user nova-compute[70869]:         <nova:swap>0</nova:swap>
Jul 25 16:08:42 user nova-compute[70869]:         <nova:ephemeral>0</nova:ephemeral>
Jul 25 16:08:42 user nova-compute[70869]:         <nova:vcpus>1</nova:vcpus>
Jul 25 16:08:42 user nova-compute[70869]:       </nova:flavor>
Jul 25 16:08:42 user nova-compute[70869]:       <nova:owner>
Jul 25 16:08:42 user nova-compute[70869]:         <nova:user uuid="f175a95c6c4e43b4b7d1910419070bf7">tempest-TestVolumeBootPattern-1492727042-project-member</nova:user>
Jul 25 16:08:42 user nova-compute[70869]:         <nova:project uuid="a0d4fe99fc224a2686f2f3daf32ecbd5">tempest-TestVolumeBootPattern-1492727042</nova:project>
Jul 25 16:08:42 user nova-compute[70869]:       </nova:owner>
Jul 25 16:08:42 user nova-compute[70869]:       <nova:ports>
Jul 25 16:08:42 user nova-compute[70869]:         <nova:port uuid="0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5">
Jul 25 16:08:42 user nova-compute[70869]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 25 16:08:42 user nova-compute[70869]:         </nova:port>
Jul 25 16:08:42 user nova-compute[70869]:       </nova:ports>
Jul 25 16:08:42 user nova-compute[70869]:     </nova:instance>
Jul 25 16:08:42 user nova-compute[70869]:   </metadata>
Jul 25 16:08:42 user nova-compute[70869]:   <sysinfo type="smbios">
Jul 25 16:08:42 user nova-compute[70869]:     <system>
Jul 25 16:08:42 user nova-compute[70869]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 25 16:08:42 user nova-compute[70869]:       <entry name="product">OpenStack Nova</entry>
Jul 25 16:08:42 user nova-compute[70869]:       <entry name="version">0.0.0</entry>
Jul 25 16:08:42 user nova-compute[70869]:       <entry name="serial">fd9d5d60-beba-4c0c-ba39-31ac33f63f91</entry>
Jul 25 16:08:42 user nova-compute[70869]:       <entry name="uuid">fd9d5d60-beba-4c0c-ba39-31ac33f63f91</entry>
Jul 25 16:08:42 user nova-compute[70869]:       <entry name="family">Virtual Machine</entry>
Jul 25 16:08:42 user nova-compute[70869]:     </system>
Jul 25 16:08:42 user nova-compute[70869]:   </sysinfo>
Jul 25 16:08:42 user nova-compute[70869]:   <os>
Jul 25 16:08:42 user nova-compute[70869]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 25 16:08:42 user nova-compute[70869]:     <boot dev="hd"/>
Jul 25 16:08:42 user nova-compute[70869]:     <smbios mode="sysinfo"/>
Jul 25 16:08:42 user nova-compute[70869]:   </os>
Jul 25 16:08:42 user nova-compute[70869]:   <features>
Jul 25 16:08:42 user nova-compute[70869]:     <acpi/>
Jul 25 16:08:42 user nova-compute[70869]:     <apic/>
Jul 25 16:08:42 user nova-compute[70869]:     <vmcoreinfo/>
Jul 25 16:08:42 user nova-compute[70869]:   </features>
Jul 25 16:08:42 user nova-compute[70869]:   <clock offset="utc">
Jul 25 16:08:42 user nova-compute[70869]:     <timer name="pit" tickpolicy="delay"/>
Jul 25 16:08:42 user nova-compute[70869]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 25 16:08:42 user nova-compute[70869]:     <timer name="hpet" present="no"/>
Jul 25 16:08:42 user nova-compute[70869]:   </clock>
Jul 25 16:08:42 user nova-compute[70869]:   <cpu mode="custom" match="exact">
Jul 25 16:08:42 user nova-compute[70869]:     <model>Nehalem</model>
Jul 25 16:08:42 user nova-compute[70869]:     <topology sockets="1" cores="1" threads="1"/>
Jul 25 16:08:42 user nova-compute[70869]:   </cpu>
Jul 25 16:08:42 user nova-compute[70869]:   <devices>
Jul 25 16:08:42 user nova-compute[70869]:     <disk type="block" device="disk">
Jul 25 16:08:42 user nova-compute[70869]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 25 16:08:42 user nova-compute[70869]:       <source dev="/dev/sdd"/>
Jul 25 16:08:42 user nova-compute[70869]:       <target dev="vda" bus="virtio"/>
Jul 25 16:08:42 user nova-compute[70869]:       <serial>db860f91-9ec2-45a2-984a-fbec37218379</serial>
Jul 25 16:08:42 user nova-compute[70869]:     </disk>
Jul 25 16:08:42 user nova-compute[70869]:     <interface type="ethernet">
Jul 25 16:08:42 user nova-compute[70869]:       <mac address="fa:16:3e:98:2d:31"/>
Jul 25 16:08:42 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:08:42 user nova-compute[70869]:       <mtu size="1442"/>
Jul 25 16:08:42 user nova-compute[70869]:       <target dev="tap0aa3d27e-6c"/>
Jul 25 16:08:42 user nova-compute[70869]:     </interface>
Jul 25 16:08:42 user nova-compute[70869]:     <serial type="pty">
Jul 25 16:08:42 user nova-compute[70869]:       <log file="/opt/stack/data/nova/instances/fd9d5d60-beba-4c0c-ba39-31ac33f63f91/console.log" append="off"/>
Jul 25 16:08:42 user nova-compute[70869]:     </serial>
Jul 25 16:08:42 user nova-compute[70869]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 25 16:08:42 user nova-compute[70869]:     <video>
Jul 25 16:08:42 user nova-compute[70869]:       <model type="virtio"/>
Jul 25 16:08:42 user nova-compute[70869]:     </video>
Jul 25 16:08:42 user nova-compute[70869]:     <rng model="virtio">
Jul 25 16:08:42 user nova-compute[70869]:       <backend model="random">/dev/urandom</backend>
Jul 25 16:08:42 user nova-compute[70869]:     </rng>
Jul 25 16:08:42 user nova-compute[70869]:     <controller type="usb" index="0" model="none"/>
Jul 25 16:08:42 user nova-compute[70869]:     <memballoon model="virtio">
Jul 25 16:08:42 user nova-compute[70869]:       <stats period="10"/>
Jul 25 16:08:42 user nova-compute[70869]:     </memballoon>
Jul 25 16:08:42 user nova-compute[70869]:   </devices>
Jul 25 16:08:42 user nova-compute[70869]: </domain>
Jul 25 16:08:42 user nova-compute[70869]:  {{(pid=70869) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337339313',display_name='tempest-TestVolumeBootPattern-server-337339313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-337339313',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqjb/4INnE5Q7haEGBoiJ2p8MTmRd3cHvxRoqpkDS9ZbSbKgpJ0XXSjxTNNldbDFAEx8QJ4zDRTocfDJ/QShLCT2MbOT51gi80w4AHoAQQEx2d5MZTCofThyZZ/3b0Hig==',key_name='tempest-TestVolumeBootPattern-1263460613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-096y062k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-25T16:08:34Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=fd9d5d60-beba-4c0c-ba39-31ac33f63f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:2d:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa3d27e-6c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_vif [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:2d:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa3d27e-6c') {{(pid=70869) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0aa3d27e-6c, may_exist=True, interface_attrs={}) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0aa3d27e-6c, col_values=(('external_ids', {'iface-id': '0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:2d:31', 'vm-uuid': 'fd9d5d60-beba-4c0c-ba39-31ac33f63f91'}),), if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:42 user nova-compute[70869]: INFO os_vif [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:2d:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa3d27e-6c')
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No BDM found with device name vda, not building metadata. {{(pid=70869) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] No VIF found with MAC fa:16:3e:98:2d:31, not building metadata {{(pid=70869) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Received event <DeviceRemovedEvent: 1690301322.8679657, b8647968-7b47-4844-9c6d-02e92d8ee999 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70869) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8647968-7b47-4844-9c6d-02e92d8ee999 {{(pid=70869) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 25 16:08:42 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully detached device vdb from instance b8647968-7b47-4844-9c6d-02e92d8ee999 from the live domain config.
Jul 25 16:08:42 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGOeyWJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:08:42 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d24470-941b-422a-b202-2040a15b7401]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:08:42 user nova-compute[70869]: No targets found.
Jul 25 16:08:42 user nova-compute[70869]: iSNS:
Jul 25 16:08:42 user nova-compute[70869]: No targets found.
Jul 25 16:08:42 user nova-compute[70869]: STATIC:
Jul 25 16:08:42 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121
Jul 25 16:08:42 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:08:42 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:08:42 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1
Jul 25 16:08:42 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:08:42 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:08:42 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379
Jul 25 16:08:42 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:08:42 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:08:42 user nova-compute[70869]: FIRMWARE:
Jul 25 16:08:42 user nova-compute[70869]: No targets found.
Jul 25 16:08:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:08:42 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:08:42 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1189453e-772f-4497-a6c6-700584632d4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a055f214-90db-46f1-ad2f-ddea7166008c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:42 user nova-compute[70869]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)
Jul 25 16:08:42 user nova-compute[70869]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 (non-flash)
Jul 25 16:08:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:08:42 user nova-compute[70869]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 (non-flash)
Jul 25 16:08:42 user nova-compute[70869]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 (non-flash)
Jul 25 16:08:42 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe41c6e1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121'): ({'sdc'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Removing single pathed devices sdc {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dbc9a7-df0a-46e7-84df-388f11fdbc7a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:42 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eb289b-874a-40c2-8685-552a1c0efba0]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Flushing IO for device /dev/sdc {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c532397-36f1-4043-ae6a-b3cc1a7562f6]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0325184-b7f4-4e2c-818b-1cc2292abbfb]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] SCSI volumes sdc have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[34abf167-91ef-4a82-a506-0ef0924a97b0]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e44ad4-73c1-4aba-9b4b-d74bfc760357]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121, portal: 172.16.0.220,3260]
Jul 25 16:08:43 user nova-compute[70869]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121, portal: 172.16.0.220,3260] successful.
Jul 25 16:08:43 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c1b17-894e-4ba5-a7fa-c1722da35121 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de9baeb-603a-4364-a949-53bb13d0015d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] <== disconnect_volume: return (305ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG nova.objects.instance [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'flavor' on Instance uuid b8647968-7b47-4844-9c6d-02e92d8ee999 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:08:43 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-c2945460-d149-4451-8735-b54f7d09eb68 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-1f6680ca-36da-48e9-9e73-bd3b2fc10473 req-4fe84798-d1f2-4448-8c7e-4a26f918f5b1 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received event network-vif-plugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1f6680ca-36da-48e9-9e73-bd3b2fc10473 req-4fe84798-d1f2-4448-8c7e-4a26f918f5b1 service nova] Acquiring lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1f6680ca-36da-48e9-9e73-bd3b2fc10473 req-4fe84798-d1f2-4448-8c7e-4a26f918f5b1 service nova] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-1f6680ca-36da-48e9-9e73-bd3b2fc10473 req-4fe84798-d1f2-4448-8c7e-4a26f918f5b1 service nova] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG nova.compute.manager [req-1f6680ca-36da-48e9-9e73-bd3b2fc10473 req-4fe84798-d1f2-4448-8c7e-4a26f918f5b1 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] No waiting events found dispatching network-vif-plugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:08:44 user nova-compute[70869]: WARNING nova.compute.manager [req-1f6680ca-36da-48e9-9e73-bd3b2fc10473 req-4fe84798-d1f2-4448-8c7e-4a26f918f5b1 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received unexpected event network-vif-plugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 for instance with vm_state building and task_state spawning.
Jul 25 16:08:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:44 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690301326.1993668, fd9d5d60-beba-4c0c-ba39-31ac33f63f91 => Resumed> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:08:46 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] VM Resumed (Lifecycle Event)
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Instance event wait completed in 0 seconds for  {{(pid=70869) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Guest created on hypervisor {{(pid=70869) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 25 16:08:46 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Instance spawned successfully.
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Found default for hw_cdrom_bus of ide {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Found default for hw_disk_bus of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Found default for hw_input_bus of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Found default for hw_pointer_model of None {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Found default for hw_video_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Found default for hw_vif_model of virtio {{(pid=70869) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 25 16:08:46 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.virt.driver [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] Emitting event <LifecycleEvent: 1690301326.2004747, fd9d5d60-beba-4c0c-ba39-31ac33f63f91 => Started> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:08:46 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] VM Started (Lifecycle Event)
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70869) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 25 16:08:46 user nova-compute[70869]: INFO nova.compute.manager [None req-8e667990-5d26-41f0-9b36-97ae1da36654 None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 25 16:08:46 user nova-compute[70869]: INFO nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Took 5.29 seconds to spawn the instance on the hypervisor.
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c7cab13-24c1-49b6-87ec-45679dcb8598 req-48864a3f-23de-47d5-a6a8-7b2c026e1590 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received event network-vif-plugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c7cab13-24c1-49b6-87ec-45679dcb8598 req-48864a3f-23de-47d5-a6a8-7b2c026e1590 service nova] Acquiring lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c7cab13-24c1-49b6-87ec-45679dcb8598 req-48864a3f-23de-47d5-a6a8-7b2c026e1590 service nova] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9c7cab13-24c1-49b6-87ec-45679dcb8598 req-48864a3f-23de-47d5-a6a8-7b2c026e1590 service nova] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:46 user nova-compute[70869]: DEBUG nova.compute.manager [req-9c7cab13-24c1-49b6-87ec-45679dcb8598 req-48864a3f-23de-47d5-a6a8-7b2c026e1590 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] No waiting events found dispatching network-vif-plugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:08:46 user nova-compute[70869]: WARNING nova.compute.manager [req-9c7cab13-24c1-49b6-87ec-45679dcb8598 req-48864a3f-23de-47d5-a6a8-7b2c026e1590 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received unexpected event network-vif-plugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 for instance with vm_state building and task_state spawning.
Jul 25 16:08:46 user nova-compute[70869]: INFO nova.compute.manager [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Took 13.13 seconds to build instance.
Jul 25 16:08:46 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-7c900de1-d504-450c-a602-78c75ffed78a tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.246s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:47 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:08:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:08:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:08:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:08:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:08:52 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:54 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:56 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:56 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:56 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:08:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:08:56 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:08:56 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70869) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:08:57 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:08:57 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:08:57 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8512MB free_disk=25.332294464111328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 78222d49-ebb3-4802-82ad-8011ad009ab7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance b8647968-7b47-4844-9c6d-02e92d8ee999 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fd9d5d60-beba-4c0c-ba39-31ac33f63f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:08:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_power_states {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid 78222d49-ebb3-4802-82ad-8011ad009ab7 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid b8647968-7b47-4844-9c6d-02e92d8ee999 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Triggering sync for uuid fd9d5d60-beba-4c0c-ba39-31ac33f63f91 {{(pid=70869) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "78222d49-ebb3-4802-82ad-8011ad009ab7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:08:59 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:00 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:09:00 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:09:01 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:09:02 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:02 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:09:04 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:04 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:09:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:09:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:09:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:09:04 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:09:04 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:09:04 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid 78222d49-ebb3-4802-82ad-8011ad009ab7 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:09:05 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updating instance_info_cache with network_info: [{"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:09:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:09:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:09:05 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:09:05 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:09:07 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:08 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:09:09 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:10 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:09:12 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:14 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:17 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:22 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:09:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:09:32 user nova-compute[70869]: INFO nova.compute.manager [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Terminating instance
Jul 25 16:09:32 user nova-compute[70869]: DEBUG nova.compute.manager [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:32 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-d08b39ae-f2c5-4e13-8c7a-7f0eb843c7b1 req-464da248-28c7-4284-b98c-a841e9479efa service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received event network-vif-unplugged-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d08b39ae-f2c5-4e13-8c7a-7f0eb843c7b1 req-464da248-28c7-4284-b98c-a841e9479efa service nova] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d08b39ae-f2c5-4e13-8c7a-7f0eb843c7b1 req-464da248-28c7-4284-b98c-a841e9479efa service nova] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-d08b39ae-f2c5-4e13-8c7a-7f0eb843c7b1 req-464da248-28c7-4284-b98c-a841e9479efa service nova] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-d08b39ae-f2c5-4e13-8c7a-7f0eb843c7b1 req-464da248-28c7-4284-b98c-a841e9479efa service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] No waiting events found dispatching network-vif-unplugged-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG nova.compute.manager [req-d08b39ae-f2c5-4e13-8c7a-7f0eb843c7b1 req-464da248-28c7-4284-b98c-a841e9479efa service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received event network-vif-unplugged-3643c773-082e-4443-b304-49ebbf0c712a for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Instance destroyed successfully.
Jul 25 16:09:33 user nova-compute[70869]: DEBUG nova.objects.instance [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lazy-loading 'resources' on Instance uuid b8647968-7b47-4844-9c6d-02e92d8ee999 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1867211563',display_name='tempest-AttachVolumeNegativeTest-server-1867211563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1867211563',id=50,image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLj4ZvG0U+Zsi3I8a+zbhuJEQB7fdCVH81kux2wvQRF5WgBu3u6/9DoZ5tzgjjIvK7yqlG09NGln0W215CvXW/UWD9HxTjrV5T3fSS8HZWXrklxfS3DuZRyR5TgPaO+Qw==',key_name='tempest-keypair-600505416',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:06:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82bbd6a3baf146179b81bda84bdd466a',ramdisk_id='',reservation_id='r-vc5cqsyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c7f43ee3-f119-42a6-81e5-b18d0ee6d581',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1624272753',owner_user_name='tempest-AttachVolumeNegativeTest-1624272753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41de05146fc5424a9f4b4852a3739135',uuid=b8647968-7b47-4844-9c6d-02e92d8ee999,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converting VIF {"id": "3643c773-082e-4443-b304-49ebbf0c712a", "address": "fa:16:3e:9e:09:72", "network": {"id": "27e2b792-295d-4fd0-8cd5-fe3247a77cef", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1991372195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82bbd6a3baf146179b81bda84bdd466a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3643c773-08", "ovs_interfaceid": "3643c773-082e-4443-b304-49ebbf0c712a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:09:72,bridge_name='br-int',has_traffic_filtering=True,id=3643c773-082e-4443-b304-49ebbf0c712a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3643c773-08') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG os_vif [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:09:72,bridge_name='br-int',has_traffic_filtering=True,id=3643c773-082e-4443-b304-49ebbf0c712a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3643c773-08') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3643c773-08, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:09:33 user nova-compute[70869]: INFO os_vif [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:09:72,bridge_name='br-int',has_traffic_filtering=True,id=3643c773-082e-4443-b304-49ebbf0c712a,network=Network(27e2b792-295d-4fd0-8cd5-fe3247a77cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3643c773-08')
Jul 25 16:09:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Deleting instance files /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999_del
Jul 25 16:09:33 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Deletion of /opt/stack/data/nova/instances/b8647968-7b47-4844-9c6d-02e92d8ee999_del complete
Jul 25 16:09:33 user nova-compute[70869]: INFO nova.compute.manager [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 25 16:09:33 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:09:33 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:09:34 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Took 1.07 seconds to deallocate network for instance.
Jul 25 16:09:34 user nova-compute[70869]: DEBUG nova.compute.manager [req-b5d99ab0-a963-487b-85ed-1b8c9b8b1c53 req-2c253b84-f520-432c-9b7e-e16e25790339 service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received event network-vif-deleted-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:09:34 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:09:35 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:09:35 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:09:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-78c62e79-d52a-4eab-86ec-fe19fdf9db22 req-1b571d2a-e71f-4116-a68f-c7a2a69343c0 service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received event network-vif-plugged-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:09:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-78c62e79-d52a-4eab-86ec-fe19fdf9db22 req-1b571d2a-e71f-4116-a68f-c7a2a69343c0 service nova] Acquiring lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:09:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-78c62e79-d52a-4eab-86ec-fe19fdf9db22 req-1b571d2a-e71f-4116-a68f-c7a2a69343c0 service nova] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:09:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-78c62e79-d52a-4eab-86ec-fe19fdf9db22 req-1b571d2a-e71f-4116-a68f-c7a2a69343c0 service nova] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:09:35 user nova-compute[70869]: DEBUG nova.compute.manager [req-78c62e79-d52a-4eab-86ec-fe19fdf9db22 req-1b571d2a-e71f-4116-a68f-c7a2a69343c0 service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] No waiting events found dispatching network-vif-plugged-3643c773-082e-4443-b304-49ebbf0c712a {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:09:35 user nova-compute[70869]: WARNING nova.compute.manager [req-78c62e79-d52a-4eab-86ec-fe19fdf9db22 req-1b571d2a-e71f-4116-a68f-c7a2a69343c0 service nova] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Received unexpected event network-vif-plugged-3643c773-082e-4443-b304-49ebbf0c712a for instance with vm_state deleted and task_state None.
Jul 25 16:09:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:09:35 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Deleted allocations for instance b8647968-7b47-4844-9c6d-02e92d8ee999
Jul 25 16:09:35 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-5c5f2644-bd6d-44cc-a3c0-7522e43eb670 tempest-AttachVolumeNegativeTest-1624272753 tempest-AttachVolumeNegativeTest-1624272753-project-member] Lock "b8647968-7b47-4844-9c6d-02e92d8ee999" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.587s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:09:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:09:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:09:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:09:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:09:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:48 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690301373.4604986, b8647968-7b47-4844-9c6d-02e92d8ee999 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:09:48 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] VM Stopped (Lifecycle Event)
Jul 25 16:09:48 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d9718e74-5929-4bb7-9163-f20effa4acb0 None None] [instance: b8647968-7b47-4844-9c6d-02e92d8ee999] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:09:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:09:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:09:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:09:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:09:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:09:57 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:09:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:09:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:09:57 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:09:57 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:09:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:09:57 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:09:58 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:09:58 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:09:58 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=25.359329223632812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 78222d49-ebb3-4802-82ad-8011ad009ab7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance fd9d5d60-beba-4c0c-ba39-31ac33f63f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:09:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:01 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:01 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:10:01 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:10:03 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:05 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:10:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:10:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:10:05 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:10:06 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updating instance_info_cache with network_info: [{"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:10:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:10:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:10:06 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:07 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:10:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:10:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:10:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:10:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:09 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:10 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:21 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-b889d84c-84e3-43f5-8b4a-52aaadfb8b18 req-c03186f8-dca5-4a6e-bc9c-e1d6d1f9f412 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received event network-changed-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:10:25 user nova-compute[70869]: DEBUG nova.compute.manager [req-b889d84c-84e3-43f5-8b4a-52aaadfb8b18 req-c03186f8-dca5-4a6e-bc9c-e1d6d1f9f412 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Refreshing instance network info cache due to event network-changed-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:10:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b889d84c-84e3-43f5-8b4a-52aaadfb8b18 req-c03186f8-dca5-4a6e-bc9c-e1d6d1f9f412 service nova] Acquiring lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:10:25 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b889d84c-84e3-43f5-8b4a-52aaadfb8b18 req-c03186f8-dca5-4a6e-bc9c-e1d6d1f9f412 service nova] Acquired lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:10:25 user nova-compute[70869]: DEBUG nova.network.neutron [req-b889d84c-84e3-43f5-8b4a-52aaadfb8b18 req-c03186f8-dca5-4a6e-bc9c-e1d6d1f9f412 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Refreshing network info cache for port 0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:10:26 user nova-compute[70869]: DEBUG nova.network.neutron [req-b889d84c-84e3-43f5-8b4a-52aaadfb8b18 req-c03186f8-dca5-4a6e-bc9c-e1d6d1f9f412 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updated VIF entry in instance network info cache for port 0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:10:26 user nova-compute[70869]: DEBUG nova.network.neutron [req-b889d84c-84e3-43f5-8b4a-52aaadfb8b18 req-c03186f8-dca5-4a6e-bc9c-e1d6d1f9f412 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updating instance_info_cache with network_info: [{"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:10:26 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-b889d84c-84e3-43f5-8b4a-52aaadfb8b18 req-c03186f8-dca5-4a6e-bc9c-e1d6d1f9f412 service nova] Releasing lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:10:27 user nova-compute[70869]: INFO nova.compute.manager [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Terminating instance
Jul 25 16:10:27 user nova-compute[70869]: DEBUG nova.compute.manager [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-aa92c059-dd84-4a53-bdfc-cf9692a4430f req-8f7703b4-6d71-45d2-8156-c210e1697d40 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received event network-changed-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-aa92c059-dd84-4a53-bdfc-cf9692a4430f req-8f7703b4-6d71-45d2-8156-c210e1697d40 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Refreshing instance network info cache due to event network-changed-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aa92c059-dd84-4a53-bdfc-cf9692a4430f req-8f7703b4-6d71-45d2-8156-c210e1697d40 service nova] Acquiring lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aa92c059-dd84-4a53-bdfc-cf9692a4430f req-8f7703b4-6d71-45d2-8156-c210e1697d40 service nova] Acquired lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG nova.network.neutron [req-aa92c059-dd84-4a53-bdfc-cf9692a4430f req-8f7703b4-6d71-45d2-8156-c210e1697d40 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Refreshing network info cache for port 0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.network.neutron [req-aa92c059-dd84-4a53-bdfc-cf9692a4430f req-8f7703b4-6d71-45d2-8156-c210e1697d40 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updated VIF entry in instance network info cache for port 0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.network.neutron [req-aa92c059-dd84-4a53-bdfc-cf9692a4430f req-8f7703b4-6d71-45d2-8156-c210e1697d40 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updating instance_info_cache with network_info: [{"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:10:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Instance destroyed successfully.
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.objects.instance [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'resources' on Instance uuid fd9d5d60-beba-4c0c-ba39-31ac33f63f91 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337339313',display_name='tempest-TestVolumeBootPattern-server-337339313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-337339313',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqjb/4INnE5Q7haEGBoiJ2p8MTmRd3cHvxRoqpkDS9ZbSbKgpJ0XXSjxTNNldbDFAEx8QJ4zDRTocfDJ/QShLCT2MbOT51gi80w4AHoAQQEx2d5MZTCofThyZZ/3b0Hig==',key_name='tempest-TestVolumeBootPattern-1263460613',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:08:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-096y062k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:08:46Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=fd9d5d60-beba-4c0c-ba39-31ac33f63f91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "address": "fa:16:3e:98:2d:31", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa3d27e-6c", "ovs_interfaceid": "0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:2d:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa3d27e-6c') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_vif [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:2d:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa3d27e-6c') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0aa3d27e-6c, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:10:28 user nova-compute[70869]: INFO os_vif [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:2d:31,bridge_name='br-int',has_traffic_filtering=True,id=0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa3d27e-6c')
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-aa92c059-dd84-4a53-bdfc-cf9692a4430f req-8f7703b4-6d71-45d2-8156-c210e1697d40 service nova] Releasing lock "refresh_cache-fd9d5d60-beba-4c0c-ba39-31ac33f63f91" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZsThjrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:10:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f494a3b1-ffbd-456a-9ba7-42f6b1d5097e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:10:28 user nova-compute[70869]: No targets found.
Jul 25 16:10:28 user nova-compute[70869]: iSNS:
Jul 25 16:10:28 user nova-compute[70869]: No targets found.
Jul 25 16:10:28 user nova-compute[70869]: STATIC:
Jul 25 16:10:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1
Jul 25 16:10:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:10:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:10:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379
Jul 25 16:10:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:10:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:10:28 user nova-compute[70869]: FIRMWARE:
Jul 25 16:10:28 user nova-compute[70869]: No targets found.
Jul 25 16:10:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:10:28 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:10:28 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ca9cbd-cb6a-4e9f-bc44-9b30da0d8538]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260c9cb-426f-4ed4-80c7-91ca9e21d9fa]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:10:28 user nova-compute[70869]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 (non-flash)
Jul 25 16:10:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:10:28 user nova-compute[70869]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 (non-flash)
Jul 25 16:10:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe4431b0c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379'): ({'sdd'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Removing single pathed devices sdd {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b1f4d-e361-4d29-ae4b-bff6528d4a66]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceccaa5-94a6-44ff-9535-de0ceee9fe41]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flushing IO for device /dev/sdd {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[882536fe-f529-44db-ba17-1f493d8fc79d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb5847-cb4f-4a81-b557-7312bab0ef8f]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] SCSI volumes sdd have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e85ae8ff', '/dev/disk/by-id/scsi-26564643439623036', '/dev/disk/by-id/scsi-1SCST_BIOe85ae8ff-edd49b066fd305a6') {{(pid=82054) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9566d25b-67d4-452f-85b2-4fe4db4bcf99]: (4, None) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a38d11-ceb5-48c2-bc5b-56d6b4be96f5]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e191b599-86ba-4307-9c88-4891bfa5a5f5]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379, portal: 172.16.0.220,3260]
Jul 25 16:10:28 user nova-compute[70869]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379, portal: 172.16.0.220,3260] successful.
Jul 25 16:10:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db860f91-9ec2-45a2-984a-fbec37218379 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[be17fa60-cbb4-4eba-872f-94a57c1a7014]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== disconnect_volume: return (358ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:10:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Deleting instance files /opt/stack/data/nova/instances/fd9d5d60-beba-4c0c-ba39-31ac33f63f91_del
Jul 25 16:10:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Deletion of /opt/stack/data/nova/instances/fd9d5d60-beba-4c0c-ba39-31ac33f63f91_del complete
Jul 25 16:10:28 user nova-compute[70869]: INFO nova.compute.manager [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Took 1.27 seconds to destroy the instance on the hypervisor.
Jul 25 16:10:28 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:10:28 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:10:29 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Took 0.65 seconds to deallocate network for instance.
Jul 25 16:10:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-b92530b7-8d9b-498f-a8cd-08d7c51a036a req-ea2a9cdc-8291-4968-b5e5-a12130fda4c8 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received event network-vif-deleted-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:10:29 user nova-compute[70869]: INFO nova.compute.manager [req-b92530b7-8d9b-498f-a8cd-08d7c51a036a req-ea2a9cdc-8291-4968-b5e5-a12130fda4c8 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Neutron deleted interface 0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5; detaching it from the instance and deleting it from the info cache
Jul 25 16:10:29 user nova-compute[70869]: DEBUG nova.network.neutron [req-b92530b7-8d9b-498f-a8cd-08d7c51a036a req-ea2a9cdc-8291-4968-b5e5-a12130fda4c8 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-b92530b7-8d9b-498f-a8cd-08d7c51a036a req-ea2a9cdc-8291-4968-b5e5-a12130fda4c8 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Detach interface failed, port_id=0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5, reason: Instance fd9d5d60-beba-4c0c-ba39-31ac33f63f91 could not be found. {{(pid=70869) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received event network-vif-unplugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] Acquiring lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] No waiting events found dispatching network-vif-unplugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received event network-vif-unplugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received event network-vif-plugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] Acquiring lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:10:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] No waiting events found dispatching network-vif-plugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:10:29 user nova-compute[70869]: WARNING nova.compute.manager [req-9d3a4cf4-7697-43ed-b575-cb8d1bfce8d8 req-0ffe8667-c0ba-46c2-91a5-aa09d02afb26 service nova] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Received unexpected event network-vif-plugged-0aa3d27e-6c52-4d9e-b9f6-25f2e4a1f9a5 for instance with vm_state active and task_state deleting.
Jul 25 16:10:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:30 user nova-compute[70869]: INFO nova.compute.manager [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Took 0.77 seconds to detach 1 volumes for instance.
Jul 25 16:10:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:10:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:10:30 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:10:30 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:10:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:10:30 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Deleted allocations for instance fd9d5d60-beba-4c0c-ba39-31ac33f63f91
Jul 25 16:10:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-899b790e-ad94-444e-8784-352a632d0358 tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "fd9d5d60-beba-4c0c-ba39-31ac33f63f91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.041s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:10:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:10:41 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:43 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690301428.1119316, fd9d5d60-beba-4c0c-ba39-31ac33f63f91 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:10:43 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] VM Stopped (Lifecycle Event)
Jul 25 16:10:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-e4ee770b-d10e-47eb-8901-b1daad2d9e2a None None] [instance: fd9d5d60-beba-4c0c-ba39-31ac33f63f91] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:10:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:10:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:10:58 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:10:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:10:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:10:58 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:10:58 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:10:58 user nova-compute[70869]: DEBUG nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70869) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 25 16:10:59 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:10:59 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:10:59 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=25.349685668945312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:10:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:10:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:10:59 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Instance 78222d49-ebb3-4802-82ad-8011ad009ab7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70869) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 25 16:10:59 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:10:59 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:10:59 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:10:59 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:10:59 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:10:59 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:11:02 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:11:02 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:11:02 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:11:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:11:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:11:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:11:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:11:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:03 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:11:05 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:11:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:11:05 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:11:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:11:05 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquired lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:11:05 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Forcefully refreshing network info cache for instance {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 25 16:11:05 user nova-compute[70869]: DEBUG nova.objects.instance [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lazy-loading 'info_cache' on Instance uuid 78222d49-ebb3-4802-82ad-8011ad009ab7 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:11:06 user nova-compute[70869]: DEBUG nova.network.neutron [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updating instance_info_cache with network_info: [{"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:11:06 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Releasing lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:11:06 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updated the network info_cache for instance {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 25 16:11:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:08 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:11:09 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:11:10 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:11:11 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:11:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:11:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:11:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:11:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:11:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:11:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-7f955972-3400-4574-95f7-95e9b38de983 req-4bc491b0-46cc-43fd-a64f-ef80ed2120d0 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received event network-changed-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG nova.compute.manager [req-7f955972-3400-4574-95f7-95e9b38de983 req-4bc491b0-46cc-43fd-a64f-ef80ed2120d0 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Refreshing instance network info cache due to event network-changed-0135b119-0f76-46d1-a7fa-fad2d0be9ee2. {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7f955972-3400-4574-95f7-95e9b38de983 req-4bc491b0-46cc-43fd-a64f-ef80ed2120d0 service nova] Acquiring lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7f955972-3400-4574-95f7-95e9b38de983 req-4bc491b0-46cc-43fd-a64f-ef80ed2120d0 service nova] Acquired lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG nova.network.neutron [req-7f955972-3400-4574-95f7-95e9b38de983 req-4bc491b0-46cc-43fd-a64f-ef80ed2120d0 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Refreshing network info cache for port 0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "78222d49-ebb3-4802-82ad-8011ad009ab7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:11:27 user nova-compute[70869]: INFO nova.compute.manager [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Terminating instance
Jul 25 16:11:27 user nova-compute[70869]: DEBUG nova.compute.manager [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Start destroying the instance on the hypervisor. {{(pid=70869) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG nova.network.neutron [req-7f955972-3400-4574-95f7-95e9b38de983 req-4bc491b0-46cc-43fd-a64f-ef80ed2120d0 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updated VIF entry in instance network info cache for port 0135b119-0f76-46d1-a7fa-fad2d0be9ee2. {{(pid=70869) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG nova.network.neutron [req-7f955972-3400-4574-95f7-95e9b38de983 req-4bc491b0-46cc-43fd-a64f-ef80ed2120d0 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updating instance_info_cache with network_info: [{"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:11:27 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-7f955972-3400-4574-95f7-95e9b38de983 req-4bc491b0-46cc-43fd-a64f-ef80ed2120d0 service nova] Releasing lock "refresh_cache-78222d49-ebb3-4802-82ad-8011ad009ab7" {{(pid=70869) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [-] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Instance destroyed successfully.
Jul 25 16:11:28 user nova-compute[70869]: DEBUG nova.objects.instance [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lazy-loading 'resources' on Instance uuid 78222d49-ebb3-4802-82ad-8011ad009ab7 {{(pid=70869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.vif [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-25T16:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1116822430',display_name='tempest-TestVolumeBootPattern-server-1116822430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1116822430',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqjb/4INnE5Q7haEGBoiJ2p8MTmRd3cHvxRoqpkDS9ZbSbKgpJ0XXSjxTNNldbDFAEx8QJ4zDRTocfDJ/QShLCT2MbOT51gi80w4AHoAQQEx2d5MZTCofThyZZ/3b0Hig==',key_name='tempest-TestVolumeBootPattern-1263460613',keypairs=<?>,launch_index=0,launched_at=2023-07-25T16:06:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0d4fe99fc224a2686f2f3daf32ecbd5',ramdisk_id='',reservation_id='r-ton1ftr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1492727042',owner_user_name='tempest-TestVolumeBootPattern-1492727042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-25T16:06:45Z,user_data=None,user_id='f175a95c6c4e43b4b7d1910419070bf7',uuid=78222d49-ebb3-4802-82ad-8011ad009ab7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converting VIF {"id": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "address": "fa:16:3e:12:79:52", "network": {"id": "a1241bee-098d-4921-a2e7-9bf9509d8611", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-966696094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0d4fe99fc224a2686f2f3daf32ecbd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0135b119-0f", "ovs_interfaceid": "0135b119-0f76-46d1-a7fa-fad2d0be9ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG nova.network.os_vif_util [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:79:52,bridge_name='br-int',has_traffic_filtering=True,id=0135b119-0f76-46d1-a7fa-fad2d0be9ee2,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0135b119-0f') {{(pid=70869) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_vif [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:79:52,bridge_name='br-int',has_traffic_filtering=True,id=0135b119-0f76-46d1-a7fa-fad2d0be9ee2,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0135b119-0f') {{(pid=70869) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0135b119-0f, bridge=br-int, if_exists=True) {{(pid=70869) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:11:28 user nova-compute[70869]: INFO os_vif [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:79:52,bridge_name='br-int',has_traffic_filtering=True,id=0135b119-0f76-46d1-a7fa-fad2d0be9ee2,network=Network(a1241bee-098d-4921-a2e7-9bf9509d8611),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0135b119-0f')
Jul 25 16:11:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] calling os-brick to detach iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe43434b880>, {'target_iqn': 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdWzmLMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 25 16:11:28 user nova-compute[70869]: WARNING os_brick.initiator.connectors.base [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb8df00-eddb-4499-ab13-497491f85613]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 25 16:11:28 user nova-compute[70869]: No targets found.
Jul 25 16:11:28 user nova-compute[70869]: iSNS:
Jul 25 16:11:28 user nova-compute[70869]: No targets found.
Jul 25 16:11:28 user nova-compute[70869]: STATIC:
Jul 25 16:11:28 user nova-compute[70869]: Target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1
Jul 25 16:11:28 user nova-compute[70869]:         Portal: 172.16.0.220:3260,-1
Jul 25 16:11:28 user nova-compute[70869]:                 Iface Name: default
Jul 25 16:11:28 user nova-compute[70869]: FIRMWARE:
Jul 25 16:11:28 user nova-compute[70869]: No targets found.
Jul 25 16:11:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 25 16:11:28 user nova-compute[70869]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 25 16:11:28 user nova-compute[70869]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70869) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1', 0)] {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabfb935-0247-4c26-bedc-98480b43ca46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade1b669-a9c8-40b9-ad93-0caa2ab104cb]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:11:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 (non-flash)
Jul 25 16:11:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe43c37beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1'): ({'sdb'}, set())}) {{(pid=70869) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Removing single pathed devices sdb {{(pid=70869) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[90de6606-1e97-49d9-b358-a775689df801]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f3040f-4cfe-44d4-ace4-6be1a9235829]: (4, ('ok\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Flushing IO for device /dev/sdb {{(pid=70869) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[579b95e0-df94-4229-bdf5-4ee3ee4ce34d]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70869) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea7e9f7-5e03-407c-a9b6-664ebea411bc]: (4, ('1', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.linuxscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] SCSI volumes sdb have been removed. {{(pid=70869) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23234653537363039', '/dev/disk/by-id/scsi-1SCST_BIOb28b0fcf-24e576099c63f8c3', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b28b0fcf') {{(pid=82054) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[db38c3f6-1768-47e8-8a57-28822d2c3c41]: (4, None) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1')] {{(pid=70869) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[207f8c33-b9d4-46cd-9104-263b08049317]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --logout {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2c913b-c9e5-4518-94f1-f05c625d9b9b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260]
Jul 25 16:11:28 user nova-compute[70869]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1, portal: 172.16.0.220,3260] successful.
Jul 25 16:11:28 user nova-compute[70869]:  stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op delete {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b72fca0-7d33-4213-b3f2-0583794eccf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82054) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d135531-1136-4b7f-8b0d-c0db51898420]: (4, ('', '')) {{(pid=82054) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70869) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.base [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] <== disconnect_volume: return (334ms) None {{(pid=70869) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Disconnected iSCSI Volume {{(pid=70869) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 25 16:11:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Deleting instance files /opt/stack/data/nova/instances/78222d49-ebb3-4802-82ad-8011ad009ab7_del
Jul 25 16:11:28 user nova-compute[70869]: INFO nova.virt.libvirt.driver [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Deletion of /opt/stack/data/nova/instances/78222d49-ebb3-4802-82ad-8011ad009ab7_del complete
Jul 25 16:11:28 user nova-compute[70869]: INFO nova.compute.manager [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 25 16:11:28 user nova-compute[70869]: DEBUG oslo.service.loopingcall [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70869) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG nova.compute.manager [-] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Deallocating network for instance {{(pid=70869) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 25 16:11:28 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] deallocate_for_instance() {{(pid=70869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG nova.network.neutron [-] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Updating instance_info_cache with network_info: [] {{(pid=70869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 25 16:11:29 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Took 0.62 seconds to deallocate network for instance.
Jul 25 16:11:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-b7841610-38dc-4a9a-a461-b36ab1ae5ff3 req-c21bb5c1-e20b-4c38-ac01-8869bb1f2015 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received event network-vif-deleted-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received event network-vif-unplugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] Acquiring lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] No waiting events found dispatching network-vif-unplugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received event network-vif-unplugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 for instance with task_state deleting. {{(pid=70869) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received event network-vif-plugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] Acquiring lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:11:29 user nova-compute[70869]: DEBUG nova.compute.manager [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] No waiting events found dispatching network-vif-plugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 {{(pid=70869) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 25 16:11:29 user nova-compute[70869]: WARNING nova.compute.manager [req-509e0310-222c-408c-bfa5-9d88b87c4c6e req-f1e63a42-b132-4426-a1a6-c14511ccb124 service nova] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Received unexpected event network-vif-plugged-0135b119-0f76-46d1-a7fa-fad2d0be9ee2 for instance with vm_state active and task_state deleting.
Jul 25 16:11:30 user nova-compute[70869]: INFO nova.compute.manager [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Took 0.83 seconds to detach 1 volumes for instance.
Jul 25 16:11:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:11:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:11:30 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:11:30 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:11:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:11:30 user nova-compute[70869]: INFO nova.scheduler.client.report [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Deleted allocations for instance 78222d49-ebb3-4802-82ad-8011ad009ab7
Jul 25 16:11:30 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-d81c0154-defd-4772-abb0-8f78af8ac87b tempest-TestVolumeBootPattern-1492727042 tempest-TestVolumeBootPattern-1492727042-project-member] Lock "78222d49-ebb3-4802-82ad-8011ad009ab7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.930s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:11:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:11:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:11:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:11:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:11:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:43 user nova-compute[70869]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690301488.1189225, 78222d49-ebb3-4802-82ad-8011ad009ab7 => Stopped> {{(pid=70869) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 25 16:11:43 user nova-compute[70869]: INFO nova.compute.manager [-] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] VM Stopped (Lifecycle Event)
Jul 25 16:11:43 user nova-compute[70869]: DEBUG nova.compute.manager [None req-47b6628e-3a7e-4c9d-b93a-65720bc21a65 None None] [instance: 78222d49-ebb3-4802-82ad-8011ad009ab7] Checking state {{(pid=70869) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 25 16:11:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:11:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:11:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:00 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:12:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:12:00 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:12:00 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:12:01 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:12:01 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:12:01 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=25.34693145751953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:12:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:12:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:12:01 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:12:01 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:12:01 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:12:01 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:12:01 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:12:01 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:12:03 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:07 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:12:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:12:07 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 16:12:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:12:09 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:10 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:11 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:12:13 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:18 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:23 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:26 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:26 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:12:28 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:29 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:33 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:38 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:12:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:12:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:12:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:12:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:12:43 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:48 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:53 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:55 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:12:58 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:13:02 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager.update_available_resource {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:13:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:13:02 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:13:02 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Auditing locally available compute resources for user (node: user) {{(pid=70869) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 25 16:13:03 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:13:03 user nova-compute[70869]: WARNING nova.virt.libvirt.driver [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 25 16:13:03 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Hypervisor/Node resource view: name=user free_ram=9121MB free_disk=25.344505310058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70869) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70869) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70869) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70869) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG nova.compute.provider_tree [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed in ProviderTree for provider: 42d61115-f6d1-4e6b-8440-2ada622c2cfd {{(pid=70869) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG nova.scheduler.client.report [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Inventory has not changed for provider 42d61115-f6d1-4e6b-8440-2ada622c2cfd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70869) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG nova.compute.resource_tracker [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Compute_service record updated for user:user {{(pid=70869) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 25 16:13:03 user nova-compute[70869]: DEBUG oslo_concurrency.lockutils [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=70869) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 25 16:13:04 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:04 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:04 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:04 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70869) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 25 16:13:08 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 25 16:13:08 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:08 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Starting heal instance info cache {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 25 16:13:08 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Rebuilding the list of instances to heal {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 25 16:13:08 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Didn't find any instances for network info cache update. {{(pid=70869) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 25 16:13:10 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:11 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:12 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:13 user nova-compute[70869]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70869) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 25 16:13:15 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:16 user nova-compute[70869]: DEBUG oslo_service.periodic_task [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70869) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 25 16:13:16 user nova-compute[70869]: DEBUG nova.compute.manager [None req-b4c7f3ff-dd83-4626-8ab5-8800a18f608b None None] Cleaning up deleted instances with incomplete migration  {{(pid=70869) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}